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CHAPTER  I 


INTRODUCTION 


1.1.  Spread-Spectrum  Multiple- Access  Communication 


In  recent  years  there  has  been  increased  interest  in  a  class  of  multiple-access 
techniques  known  as  spread-spectrum  multiple-access  (SSMA).  The  SSMA  tech¬ 
niques  are  those  multiple-access  methods  in  which  the  multiple-access  capability 
is  due  primarily  to  coding  and  in  which  -  unlike  traditional  time-  and  frequency- 
division  multiple-access  -  there  is  no  requirement  for  precise  time  or  frequency 
coordination  between  the  transmitters  in  the  system.  One  attractive  feature  of 
SSMA  is  the  difficulty  of  detection  by  an  unauthorized  receiver.  Another  advan¬ 
tage  of  SSMA  is  that  it  is  relatively  easy  to  add  additional  users  to  the  system. 
However,  probably  the  dominant  reason  for  considering  SSMA  is  the  need  for 
some  type  of  external  interference  rejection  capability  such  as  multipath  rejec¬ 
tion  or  resistance  to  intentional  jamming. 

SSMA  techniques  have  been  considered  for  a  variety  of  satellite  systems 
[San  81],  systems  to  provide  communication  to  aircraft  and  other  mobile  users 
[Leb  71],  [Coo  78],  [Goo  80],  air  traffic  control  systems  [Sti.  73]. 

The  two  most  common  forms  of  SSMA  are  frequency-hopped  (FH)  SSMA 
and  direct-sequence  (DS)  SSMA.  In  DS-SSMA  [Leh  84],  [Pur  81b],  each  user 


is  given  its  own  code,  which  is  approximately  orthogonal  (i.e.,  has  low  cross 
correlation)  with  the  codes  of  the  other  users.  The  carrier  is  phase  modulated 
by  the  digital  data  sequence  and  the  code  sequence.  In  FH-SSMA  [Pur  84],  each 
user  is  assigned  a  unique  frequency  hopping  pattern,  so  that  the  RF  signal  from 
a  given  transmitter  is  hopped  from  slot  to  slot  by  changing  the  carrier  frequency 
according  to  its  own  hopping  pattern. 

This  thesis  is  concerned  with  the  application  of  FH-SSMA  techniques  to  com¬ 
munication  networks.  We  are  interested  in  the  multiple-access  capability  of  a 
frequency-hop  packet  radio  network  as  characterized  by  the  user-channel  model 
described  in  section  1.2.  The  goals  of  this  thesis  are  to  find  the  theoretical  limit 
in  performance  and  to  show  how  to  achieve  the  limit  through  the  use  of  channel 
coding  techniques. 

1.2.  The  User-Channel  Model 

We  consider  a  frequency-hop  spread-spectrum  (FH/SS)  packet  radio  network 
in  which  I  transmitter-receiver  pairs  (also  called  user  pairs)  of  terminals  wish 
to  communicate  over  a  common  channel  (see  Figure  1.1).  Each  source  generates 
messages  (information),  independent  of  messages  generated  by  other  users.  There 
are  I  separate  encoders,  one  for  each  source.  The  jtk  encoder  has  as  input  only  the 
messages  from  the  jtk  source  and  produces  a  codeword  (x;1,x;2,  •  •  • , *,■„),  x>»  € 
X,  where  X  is  a  common  input  alphabet.  At  the  jtk  receiver  the  jtk  frequency 
dehopper,  which  has  knowledge  of  the  j,k  hopping  pattern,  dehops  the  received 
signal  and  the  dehopped  signal  is  demodulated  to  produce  the  output  vector 
(y>i»y>j> •  •  •  »y>n),  y><  €  Y ,  where  Y  is  a  common  output  alphabet.  Decoding  is 
done  independently  at  each  of  the  I  receivers  and  thus  there  is  no  cooperation 
between  users  on  either  the  transmitting  or  the  receiving  side.  We  thus  model 


Figure  1.1:  /-user  channel  model. 


the  communication  system  from  the  modulator  input  to  the  demodulator  output 
as  an  I- user  interference  channel  [Gam  80). 

We  assume  that  each  receiver  is  able  to  hear  the  transmissions  of  each  of  the 
I  transmitters.  Each  receiver  does  not  attempt  to  dehop  and  demodulate  signals 
other  than  its  own.  The  signal  of  each  user  is,  however,  present  in  the  front  end 
of  each  receiver  and  is  a  potential  source  of  interference.  An  example  of  this  is  a 
satellite  multiple  access  broadcast  system  or  a  fully  connected  network.  Thus  the 
interference  traffic  level  will  be  the  same  at  each  receiver  in  the  network,  which 
makes  the  component  channels  for  all  user  pairs  be  identical.  We  thus  assume 
that  exactly  the  same  code  is  used  for  all  user  pairs  in  the  network. 

The  users  are  assumed  to  transmit  data  in  fixed-length  packets,  and  the 
packet  may  consist  of  several  codewords.  In  this  thesis  we  will  assume  that  a 
“packet”  consists  of  exactly  one  codeword  from  the  code.  This  provides  us  with 
a  natural  definition  of  a  “successfully  transmitted  packet”:  A  packet  is  declared 
successfully  transmitted  if  the  number  of  errors  and/or  erasures  occuring  due  to 
multi-user  interference  is  within  the  errors-and-erasures  correcting  capability  of 
the  code. 

In  our  model  of  a  frequency-hop  radio  network,  there  is  a  band  of  q  frequency 
slots  available  and  each  user  pair  has  a  frequency  hopping  pattern  that  randomly 
hops  among  all  q  frequency  slots  with  probability  1  jq  for  each  slot  independent 
of  previous  hop  frequencies  (i.i.d.  hopping).  In  each  hopping  time-slot,  N, \  code 
symbols  are  transmitted  using  a  common  type  of  modulation  whose  spectrum 
falls  within  the  specified  frequency  slot.  In  general,  frequency  hopping  for  the 
terminals  in  the  network  can  be  either  synchronous  or  asynchronous.  The  re¬ 
quirement  for  synchronous  frequency  hopping  is  that  the  hop  intervals  from  all  of 
the  transmitters  in  the  network  must  be  aligned  at  each  receiver  in  the  network. 
The  term  asynchronous  frequency  hopping  is  reserved  for  the  situation  where 


this  requirement  is  not  met.  We  also  assume  that  packet  time  slotting  is  em¬ 
ployed,  that  is,  time  is  divided  into  intervals  called  packet  (time)  slots,  and  each 
packet  transmission  must  take  place  wholly  within  a  packet  slot.  The  conditions 
required  for  slotted  transmission  are  much  less  strict  than  the  requirements  for 
synchronous  frequency  hopping:  Because  the  packet  slot  size  is  typically  one  to 
three  orders  of  magnitude  greater  than  the  hop  size  (hop  duration  time),  it  is 
considerably  easier  to  implement  a  slotted  packet  transmission  system  than  to 
synchronize  the  frequency  hopping  among  all  of  the  terminals  in  the  network. 
In  particular,  a  guard  time  of  a  few  percent  of  the  packet  length  is  sufficient  to 
permit  slotted  operation  in  the  packet  radio  network,  and  therefore  represents  a 
small  degree  of  added  overhead. 

Whenever  two  or  more  code  symbols  from  different  radios  are  transmitted 


simultaneously  in  the  same  frequency  slot,  we  say  a  “hit”  occurs.  Suppose  two 
packets  are  transmitted  in  the  same  packet  slot  on  two  different  hopping  patterns, 
and  consider  a  single  symbol  from  one  of  them.  The  probability  that  the  other 
packet  has  symbol  transmitted  in  the  same  frequency  slot  at  any  time  during 
the  transmission  interval  for  that  symbol  is  called  the  probability  of  a  hit  and  is 

denoted  by  p*.  It  is  known  that  p*  can  be  calculated  as  [Ger  82] 

’ 

^  [l  +  j^(l  -  *)]  ,  asynchronous  frequency  hopping 
Ph  —  '  (1-1) 

synchronous  frequency  hopping, 

where  Nk  is  the  number  of  code  symbols  per  hop.  If  there  are  I  simultaneous 
transmissions,  the  probability  of  a  particular  symbol  being  hit  is 

PM  =  1  -  (1  -  p*),_l.  (1.2) 

Since  each  receiver  can  hear  the  transmissions  of  ail  I  transmitters,  the  proba¬ 
bility  of  a  particular  symbol  being  hit  will  be  the  same  at  all  receivers,  namely 
PM-  We  will  assume  that  the  background  noise  power  is  small  compared  with 
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the  signal  power,  so  that  when  there  is  no  interference  at  a  particular  hop,  the 
data  is  correctly  received. 

1.3.  Previous  Work 

Studies  of  the  multiple-access  capability  of  frequency-hop  spread-spectrum 
communication  systems  have  begun  quite  recently.  Geraniotis  and  Pursley  [Ger  82] 
have  obtained  the  (uncoded)  bit  error  probability  in  an  asynchronous  frequency- 
hop  SSMA  communication  system.  Soon  after,  the  use  of  frequency-hopping, 
M- ary  modulation,  and  Reed-Solomon  coding  in  a  multiple-terminal  communica¬ 
tion  system  was  considered  in  [Haj  82],  [McE  82],  [Pur  81a].  In  particular,  Hajek 
[Haj  82],  [Pur  81a]  have  evaluated  the  throughput  of  frequency-hopped  commu¬ 
nications  with  error-correction  coding  for  a  Poisson  traffic  model.  Musser  and 
Daigle  [Mus  82]  derived  the  throughput  of  an  unslotted  code  division  multiple 
access  (CDMA)  network  with  fixed  length  packets.  Pursley  [Pur  83a]  examined 
the  improved  multiple-access  capability  available  through  the  use  of  frequency- 
hopping  with  side  information  and  erasure-correction.  In  [Pur  84]  he  also  evalu¬ 
ated  error  probabilities  and  local  throughput  of  the  frequency-hop  radio  networks 
which  incorporate  the  standard  slotted  and  unslotted  ALOHA  channel-access 
protocols,  and  Reed-Solomon  error-control  coding.  Hegde  and  Stark  [Heg  85] 
considered  the  multiple-access  capability  of  frequency-hop  spread-spectrum  com¬ 
munication  from  an  information  theoretic  (capacity)  point  of  view.  It  was  shown 
that  there  is  an  optimal  number  of  users  that  maximizes  the  total  information 
being  reliably  transmitted. 

Spread-spectrum  network  protocols  have  been  discussed  in  the  literature 
[Pur  83b],  [Sil  84],  [Sou  84],  [Wie  82],  but  the  design  and  analysis  of  these  pro¬ 
tocols  are  still  an  active  area  of  basic  research,  and  several  problems  remain  un- 


solved.  Raychaudhuri  [Ray  81]  presented  analytical  techniques  for  performance 
evaluation  (such  as  steady-state  throughput,  delay)  of  slotted  ALOHA  CDMA 
systems.  In  [Wie  83],  [Wie  86]  a  distributed  reservation  scheme  for  SSMA  chan¬ 
nels  has  been  introduced  and  analyzed. 

1.4.  Thesis  Outline 

In  this  section  we  briefly  outline  the  remaining  chapters  of  this  thesis.  In 
chapter  II,  several  performance  measures  of  the  multiple-access  capability  which 
are  to  be  discussed  throughout  this  thesis  are  stated.  Those  are  the  channel  ca¬ 
pacity,  the  achievable  region,  and  the  throughput.  In  brief,  the  channel  capacity 
is  the  maximum  average  amount  of  information  that  can  be  transmitted  over  the 
channel  with  the  best  possible  code.  The  achievable  region  is  the  set  of  all  code 
rate,  channel  traffic  pairs  such  that  it  is  possible  to  have  the  packet  (codeword) 
error  probability  to  be  less  than  a  desired  error  probability.  The  throughput  is 
the  average  number  of  successful  transmissions  that  can  take  place  within  the 
range  of  a  given  receiver. 

Chapter  III  is  concerned  with  the  multiple-access  capability  of  a  frequency- 
hop  packet  radio  network  which  utilizes  Reed-Solomon  coding.  Reed-Solomon 
(RS)  codes  are  employed  to  correct  the  errors  and/or  erasures  occurring  due  to 
multi-user  interference.  If  the  receiver  can  detect  the  presence  of  interference 
in  the  same  frequency  slot  in  which  the  signal  of  interest  is  present  (side  infor¬ 
mation)  and  erase  the  corrupted  channel  symbols,  the  unique  erasure-correcting 
capability  of  the  RS  codes  can  be  exploited.  In  general,  an  (n,  k)  RS  code  can 
correct  up  to  e  =  n  -  k  erasures  out  of  n  symbols  or  up  to  t  =  [(n  -  k)/ 2J  errors 
out  of  n  symbols:  this  is  the  best  value  of  e  and  t  that  can  be  achieved  by  any 
code  of  the  same  block  length  and  rate.  This  is  often  a  strong  justification  for 


using  RS  codes.  For  both  the  perfect  side  information  and  no  side  information 
cases,  we  derive  the  achievable  regions  of  code  rate  and  channel  traffic,  and  the 
optimal  code  rate  and  optimal  channel  traffic  at  which  the  normalized  through¬ 
put  is  maximized.  From  these  optimum  points  we  derive  the  maximum  possible 
throughputs,  and  compare  them  with  the  corresponding  channel  capacities.  It 
is  found  that  for  the  perfect  side  information  case,  the  maximum  sum  capacity 
(defined  in  section  2.2)  is  achieved  by  the  optimal  rate  RS  code  with  bounded  dis¬ 
tance  decoding.  However  it  is  shown  that  the  maximum  (normalized)  throughput 
achievable  without  side  information  is  only  39.3%  (worst  case)  of  that  achievable 
with  perfect  side  information.  The  loss  in  using  Reed-Solomon  codes  in  a  no  side 
information  environment  is  partially  due  to  the  use  of  a  non  maximum  likelihood 
decoder  (i.e.,  bounded  distance  decoder). 

In  chapter  IV,  we  investigate  a  technique  for  obtaining  the  side  information. 
This  is  done  by  partitioning  the  data  stream  into  blocks,  encoding  each  block 
using  an  error-detecting  code,  and  transmitting  the  encoded  block  (codeword) 
during  a  single  hop.  On  the  basis  of  the  received  version  of  the  codeword  the 
decoder  makes  a  statistical  decision  about  which  of  the  channel  states  (hit  or 
no  hit)  each  codeword  was  transmitted  over.  Clearly,  as  the  rate  of  the  error¬ 
detecting  code  decreases,  the  error  detection  capability  increases,  therefore  the 
reliability  of  side  information  obtained  will  increase.  However,  decreasing  the 
code  rate  implies  a  decrease  in  the  efficient  use  of  the  channel.  An  interesting 
question  that  arises  from  this  discussion  is  “How  does  the  reliability  of  the  side 
information  change  as  the  code  rate  changes?-,  or  “What  is  the  maximum  allow¬ 
able  code  rate  to  obtain  a  certain  reliability  of  the  side  information?”.  In  this 
chapter  we  give  the  answer  to  the  above  question  for  both  the  synchronous  and 
asynchronous  frequency-hopping  systems. 

The  combination  of  encoder,  channel,  and  decoder  generates  in  general  an 
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errors-and-erasures  channel.  The  above  encoder  and  decoder  will  be  called  later 
as  inner  encoder  and  inner  decoder  respectively.  We  employ  an  outer  code  to 
correct  the  errors  (caused  by  undetected  errors)  and  the  erasures  (caused  by 
detected  errors).  In  this  way  the  inner  decoder  informs  the  outer  decoder  which 
symbols  (inner  codewords)  in  the  received  packet  have  been  hit  by  symbols  from 
other  packets  in  the  same  time  slot.  We  find  that  the  normalized  throughput 
achievable  with  perfect  side  information  can  indeed  be  achieved  through  the  use 
of  this  concatenated  coding  scheme,  even  though  the  channel  provides  no  side 
information.  This  chapter  ends  by  evaluating  the  performance  of  diversity  /  RS 
code  as  an  example  of  the  concatenated  coding  schemes. 

In  chapter  V,  we  consider  the  performance  of  frequency-hopping  multiple- 
access  systems  which  have  imperfect  side  information  at  the  demodulator.  In 
fact,  perfect  side  information  and  no  side  information  are  special  cases  of  the 
imperfect  side  information.  When  imperfect  side  information  is  available  at  the 
demodulator,  its  output  is,  in  general,  a  sequence  of  errors,  erasures,  and  correct 
symbols.  In  order  to  correct  the  errors  and  erasures  we  employ  a  Reed-Solomon 
code,  and  consider  two  different  decoders  for  it:  one  is  the  errors-and-erasures 
decoder  and  the  other  is  a  parallel  decoder.  We  first  evaluate  the  performance  of 
errors-and-erasures  decoder  and  discuss  am  idea  for  improving  the  performance. 
Based  on  this  idea  we  suggest  a  parallel  decoding  scheme  and  evaluate  the  per¬ 
formance  of  it  over  the  imperfect  side  information  channel. 

Finally  in  chapter  VI,  conclusions  are  made. 


CHAPTER  II 


PERFORMANCE  MEASURES 


2.1  Introduction 


Up  to  now  our  characterization  of  the  performance  of  frequency-hop  multiple 
access  systems  has  been  qualitative.  In  this  chapter,  this  characterization  is  made 
more  precise  by  examining  specific  quantitative  performance  measures:  these  are 
the  capacity  region,  the  achievable  (rate,  traffic)  region,  and  the  throughput. 
Such  measures  not  only  are  needed  for  analytical  and  numerical  comparisons 
of  the  effectiveness  of  different  multiple  access  systems,  but  are  also  used  in 
optimizing  the  performance  of  a  given  multiple  access  system.  In  the  latter  case, 
the  performance  measure  acts  as  the  objective  function  in  the  problem  of  selecting 
the  best  system  parameter  values  and/or  operational  modes. 

2.2  The  Interference  Channel 


The  I- user  interference  channel  has  I  transmitters  and  I  receivers.  Trans¬ 
mitter  j  wishes  to  send  information  to  receiver  j.  He  does  not  care  what  other 
receivers  receive  or  understand.  It  is  not  quite  a  broadcast  channel  because 


there  is  only  one  intended  receiver  for  each  transmitter,  nor  is  it  a  multiple  ac¬ 
cess  channel  because  each  receiver  is  only  interested  in  what  is  being  sent  by  the 
corresponding  transmitter. 

The  7-user  interference  channel  is  characterized,  in  general,  by  (X2  x  X2  x 

x  Xf,  P(yi,  y2,  •  •  •  ,yi  |  X|,  x2,  •  •  • ,  £/),  Yi  x  Y2  x  •  •  •  x  Yi)  consisting  of  2 1 
finite  sets  Xiy  X2,  •  •  • ,  Xi,  Yu  Y2,  •  •  • ,  Yj  and  a  collection  of  conditional  probability 
distributions  P{-,-  [  xu  x2,  •  •  • ,  x,)  on  Yl  x  Y2  x  •  •  •  x  Y>,  one  for  each 

vector  (x!,x2,---,x/)  where  xj  6  Xux2  €  X2,---,xj  €  X/.  Here  x^xj.-.x; 
are  inputs  to  the  channel  and  j/i ,y2, *••,!//  are  outputs  from  the  channel  (see 
Figure  1.1).  In  our  interference  channel  model,  Xx  =  X2  =  ■•■  =  Xr  and 
yi  =  y2  =  • .  •  =  y>. 

Using  Sato  s  terminology  [Sat  77],  if  the  marginal  transition  probabilities 
PiVi  I  xi>  ‘  ‘  i  x/),  do  not  depend  on  x,,  i  ^  j,  i.e., 

p{yj  I  *2,  •  •  *,  Xi)  =  P(yy  I  Xj),  j  =  1,2,  •  •  •,  I,  (2.1) 

then  the  interference  channel  is  called  “separated”.  The  interference  channels 
created  by  a  specific  frequency-hopping  modulation  will  be  characterized  by  the 
marginal  transition  probabilities  P(y;-  |  xu  x2,  •  •  • , x7),  j  =  1, 2,  •  •  • ,  I.  We  will 
show  later  how  the  marginal  transition  probabilities  depend  on  the  frequency- 
hopping  modulation  (e.g.  number  of  frequency  slots,  hopping  pattern)  and  avail¬ 
ability  of  side  information.  If  the  interference  channel  is  separated,  the  individ¬ 
ual  channels  characterized  by  P(y;  |  x;)  are  called  “component”  channels.  In  our 
model  the  component  channels  for  all  user  pairs  are  identical. 

2.3  Capacity  Region 

In  general,  by  the  “capacity  region”  of  any  interference  channel,  one  means  the 
set  of  all  joint  user  rates  such  that  it  is  possible  to  communicate  with  arbitrarily 
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small  error  probability  at  any  joint  rate  inside  this  set,  but  it  is  impossible  to 
do  so  at  any  joint  rate  outside  this  set.  To  define  the  capacity  region  for  such 
channels  precisely,  it  is  convenient  to  make  use  of  the  concept  of  the  “achievable 
rate”.  An  ((My,M2,  •  •  •  ,M/),  n)  code  for  an  I- user  interference  channel  consists 


of  I  sets  of  integers  called  the  message  set 


=  {l,2,---,Mj},  j  =  1,2,--,/, 


1  encoding  functions 


fr-  M,  —  A™,  j  =  1,2, •••,/, 


and  I  decoding  functions 


9j  :  Y?  -*  M,,  j  =  1,2, •••,/. 


Assuming  an  uniform  distribution  over  the  product  message  sets  Mj  x  Mj  x 


•••  x  M/,  i.e.,  that  the  messages  are  independent  and  equally  likely,  we  define 
the  “average  probability  of  error”  for  the  jth  channel  to  be 


- 


P}n>(e) 


My  •  •  M/ 


-xMi 


S;(y>)  ^  rrij  I  (mlt  •  •  • ,  mj)  sent), 


where  y;  €  Y*. 

We  define  the  rate  vector  (ri,r2,-  •  -,rj)  of  an  {[My,M2,  -  -  -  ,Mj),  n)  code  by 

_  loj.M,  .  ,  ___  . 


;  =  1,2, •••,/. 


The  rate  vector  (r!,r2,-  •  -,rj)  is  said  to  be  achievable  by  an  /-user  interfer¬ 


ence  channel  if,  for  any  c  >  0  and  for  all  n  sufficiently  large,  there  exists  an 


((My, Mi,  -  -  -  ,Mi ),  n)  code  with 


My  >  2nr‘,  Mj  >  2nra,  •••  ,M]  >  2nr' , 


such  that 


P}n)(e)<£,  Pj(n)(e)<€,  Pln](e)<e. 


V'  ■X/Ol' J**'. 


■  ■/  s'aVVA"  ■ 


t~i  >  ■  !■>  t*  |'  1*«  !<»' 


vui. 


The  capacity  region  of  the  /-user  interference  channel  is  defined  as  the  set  of  all 
achievable  rate  vectors  in  the  (r^rj,-  •  -,r/)-space. 

Notice  that  the  notions  of  achievable  rates  and  capacity  region  depend  only 
on  the  marginal  transition  probabilities  of  the  channel,  P(y,  j  zlt  x2,  •  •  •  ,x/),  and 
not  directly  on  the  joint  conditional  probability  P(yi, y2,  •  •  • ,  V/  i  Xi,zj,"-,x/). 
This  is  because  the  average  probability  of  error  Pjn\e)  ( j  =  1,2,-  •  •,/)  depends 
only  on  the  corresponding  marginal  probability 

Pj(vj  I  •••»*/)  =  £  P(yit»*»-*-.y/  I  •••.*/)•  (2-7) 

Vk,&i 

From  this,  we  can  conclude  that  the  capacity  region  is  the  same  for  all  /-user 
channels  that  have  the  same  marginal  probabilities. 

The  capacity  region  for  the  interference  channel  is  not,  in  general,  known, 
but  various  inner  and  outer  bounds  have  been  developed  for  it  {Ahl  71],  jSat  77]. 
However,  if  the  channel  is  separated,  i.e., 

PjiVi  I  *  *.*/)  =  Pj{Vj  I  Xj),  j  =  1,2,  •••,/,  (2.8) 

then  using  the  properties  given  in  [Sat  77]  it  can  be  shown  that  the  inner  bounds 
and  the  outer  bounds  coincide,  thus  giving  us  the  capacity  region: 

{(rii»’2,-  •  •  >rr)  :  0  <  r,  <  C,(/)},  (2.9) 


where 

CA1)  =maxg;/(XJ;yj)  (2.10) 

is  the  capacity  of  the  jth  component  channel  which  is  described  by  (Xj,  P(y;|x;),  V; 
This  implies  that  the  capacity  regions  of  the  separate  interference  channel  are 
determined  by  the  individual  channel  parameters  only.  Reducing  the  rate  of  one 
user  is  of  no  benefit  to  other  users. 

The  sum  capacity,  CfUm(/),  is  defined  as  the  largest  possible  total  rate  that 
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can  be  achieved  by  all  users,  and  if  the  channel  is  separated 

C'jum(-f)  =  TCIHXq l...Q ,  2Zj  =  l  i  Tj) 

=  E,'„max«,7(X,;  Y,)  (2.11) 

=  S{-.Cy(/)- 

2.4  Achievable  Region 

In  the  previous  section  we  have  considered  the  performance  achievable  with 
the  best  possible  codes,  i.e.,  the  capacity  region.  The  coding  theorem  guarantees 
the  existence  of  codes,  but  does  not  provide  any  criteria  for  construction  or 
selection  of  such  codes.  The  capacity  region  is  a  property  of  a  channel.  This 
section  and  the  next  section  are  focused  on  a  coding  viewpoint.  We  assume  that 
all  encoders  have  same  rate  and  are  identical.  We  first  consider  an  achievable 
region  of  a  family  of  interference  channels  with  a  family  of  codes.  The  achievable 
region  is  defined  as  the  set  of  all  code  rate  (r),  channel  traffic  (I)  pairs  such 
that  there  exists  a  code  with  rate  r  and  codeword  error  probability  less  than 
some  desired  value,  Pe,  for  I  users  (packet  transmissions).  The  codeword  error 
probability  is  the  probability  of  the  number  of  errors  and  erasures  occuring  in  the 
received  sequence  being  greater  than  the  correcting  capability  of  the  code.  The 
set  of  all  (r,  I)  such  that  the  codeword  (packet)  error  probability  is  less  than  PE 
is  the  "PE  achievable  region” .  The  requirement  for  Pe  on  the  individual  links  is 
closely  coupled  to  the  system  delay:  a  larger  packet  error  probability  implies  that 
a  larger  number  of  retransmissions  will  be  required,  and  this  implies  increased 
delay. 

The  effectiveness  of  a  class  of  coding  schemes  on  a  given  channel  (i.e.,  given  I) 
can  be  measured  by  letting  the  code  length  become  sufficiently  large  and  compar¬ 
ing  the  resulting  maximum  possible  (maximized  over  all  codes  in  a  specific  class) 


code  rate  for  the  codeword  error  probability  to  be  less  than  an  arbitrarily  small 
constant  with  the  absolute  maximum  rate,  i.e.,  the  capacity.  Many  people  have 
been  searching  for  practical  realization  of  Shannon’s  promises,  but  the  search  has 
been  difficult  and  only  partially  completed.  In  fact,  the  problem  of  finding  an 
explicitly  constructable,  practical  sequence  of  codes  for  which  the  probability  of 
error  approaches  zero  for  all  rates  less  than  the  capacity  region  remains  open  in 
general. 

2.5  Throughput 

Throughput  is  a  widely-accepted  performance  measure  for  a  satellite  packet 
broadcasting  system  [Kle  76].  Basically,  it  is  intended  to  be  a  measure  of  the 
information  flow  in  the  neighborhood  of  an  arbitrary  terminal  in  the  network.  It 
is  defined  as  the  average  number  of  successful  packet  transmissions  that  can  take 
place  simultaneously  within  the  range  of  a  given  receiver.  If  the  network  is  homo¬ 
geneous  in  the  sense  that  the  interference  traffic  is  the  same  at  each  receiver,  the 
codeword  (packet)  error  probability  given  I  simultaneous  transmissions,  Pe{I), 
is  the  same  for  each  packet,  and  the  unnormalized  throughput  given  I  simulta¬ 
neous  transmissions,  S(I),  is  the  number  of  transmissions  times  the  probability 
of  success;  that  is, 

S(/)  =  /.(l-P£(/)).  (2.12) 

Notice  that  this  throughput  measure  does  not  distinguish  between  packets  ac¬ 
cording  to  their  destination.  It  is  a  measure  of  the  multiple-access  capability  of 
the  modulation  and  coding  technique  which  is  divorced  from  the  particular  pro¬ 
tocols  being  used  in  the  network.  A  packet  is  correctly  received  if  the  number  of 
errors  and  erasures  it  encounters  is  within  the  correction  capability  of  the  code. 

In  order  to  make  valid  comparisons  between  frequency-hop  and  narrowband 


radio  networks,  it  is  necessary  to  normalize  S(J)  to  give  throughput  per  unit 
bandwidth.  If  the  code  has  rate  r  and  the  number  of  frequency  slots  is  q,  the 
normalized  throughput  at  traffic  level  I  is 


W(I)  =  rS(I)/q 

=  rI{l-PE(I))/q; 


(2.13) 


this  is  the  total  amount  of  information  being  reliably  sent  over  the  network 
per  unit  time  per  unit  bandwidth.  As  the  code  rate  decreases,  the  amount  of 
bandwidth  required  (for  fixed  q  and  information  bit  rate)  increases  so  that  the 
normalization  factor,  r/q,  decreases.  However,  the  smaller  the  code  rate  the 
greater  the  error  and  erasure  correcting  capability  of  the  code.  The  larger  error 
and  erasure  correcting  capability  of  the  code  tends  to  increase  the  unnormalized 
throughput.  These  two  competing  factors  cause  there  to  be  an  optimum  code 
rate  that  maximizes  the  normalized  throughput.  Alternatively  we  can  imagine 
that  for  fixed  q  as  the  number  of  transmitter-receiver  pairs  increase  there  will  be 
a  decrease  in  the  reliability  of  the  information  being  transmitted.  This  is  because 
the  chances  of  more  than  one  user  hopping  to  the  same  frequency  slot,  i.e.  the 
probability  of  a  hit,  are  larger  for  larger  /.  On  the  other  hand  as  the  number 
of  user  pairs  increases,  the  total  amount  of  information  being  transmitted  is 
increasing.  From  this  discussion  one  is  led  to  believe  that  for  a  fixed  q  there 
will  be  an  optimum  number  of  users  simultaneously  transmitting  that  maximizes 
the  normalized  throughput.  The  values  of  I  and  r  for  which  W{I)  is  maximized 
is  denoted  by  /<*,  and  r^,  respectively.  For  frequency-hop  radio  networks  with 
error-control  coding,  the  value  of  Iopt  depends  on  the  code  and  the  bandwidth 
used  by  the  spread  spectrum,  but  it  is  typically  much  larger  than  one.  The 
value  of  ropt  depends  on  the  number  of  users  simultaneously  transmitting  and 
the  bandwidth  used  by  the  spread  spectrum.  From  these  two  optimum  values 


we  can  derive  the  maximum  possible  normalized  throughput 


CHAPTER  III 


REED-SOLOMON  CODES 


3.1  Introduction 


An  important  and  popular  subclass  of  nonbinary  BCH  codes  is  the  class  of 
Reed-Solomon  codes  often  abbreviated  as  RS  codes  [Cla  82],  [Bla  83].  They 
are  BCH  codes  over  GF(M)  with  the  special  property  that  the  block  length 
n  is  M  —  1,  M,  or  M  +  1,  where  M  is  a  power  of  a  prime.  Besides  serving 
as  illuminating  examples  of  BCH  codes,  they  are  of  considerable  practical  and 
theoretical  importance.  They  are  convenient  for  building  other  codes,  either 
alone  or  in  combination  with  other  codes,  as  in  concatenated  codes  which  will  be 
discussed  in  chapter  IV.  In  this  chapter  we  investigate  the  achievable  region  and 
the  throughput  for  the  family  of  interference  channels  generated  by  our  spread- 
spectrum  frequency-hopping  model  of  Chapter  I,  when  only  RS  codes  are  used. 

An  important  property  of  any  (n,  k)  RS  code  is  that  the  minimum  distance 
is  given  by 

<U„  =  n-fc  +  1,  (3.1) 


where  n  is  the  block  length  and  k  is  the  number  of  information  symbols  in  each 
block.  A  code  for  which  the  minimum  distance  equals  n  —  k  +  1  is  called  a 


maximum-distance-separable  (MDS)  code.  Therefore,  every  RS  code  is  an  MDS 
code  and  is  optimum  in  the  sense  of  the  Singleton  bound  [Bla  83].  This  means 
that  for  fixed  n  and  it,  no  code  can  have  a  larger  minimum  distance  than  a  RS 
code.  This  is  often  a  strong  justification  for  using  RS  codes.  Furthermore,  it 
can  be  readily  verified  that  shortening  the  block  length  of  a  RS  code  by  omitting 
information  symbols  can  not  reduce  its  minimum  distance,  and  therefore  any 
shortened  RS  code  is  also  an  MDS  code. 

Another  important  property  of  a  RS  code  is  the  fact  that  any  k  positions  in 
the  codeword  may  be  used  as  an  information  set.  That  is,  given  an  (n,  k)  RS  code 
over  GF(M),  for  any  k  symbol  positions  there  will  be  one  and  only  one  codeword 
corresponding  to  each  of  the  M*  assignments  in  those  k  positions.  An  important 
and  very  useful  consequence  of  this  property  is  that  it  enables  one  to  write  down 
the  exact  weight  distribution  for  any  RS  code.  The  weight  distribution  {A,}  for 
a  RS  code  or  any  MDS  code  defined  over  GF(M)  having  block  length  n  and 
minimum  distance  d is  given  by 


(■) 

(  \ 
3  ~  1 

A;  = 

(M  -  1)  £  (-1)' 

,  ‘  , 

l  j  ) 

J=0 

M;-d— 


(3.2) 


for  dmin  <  j  <  n.  Derivation  of  this  weight  distribution  formula  can  be  found  in 
Forney  [For  66],  Berlekamp  [Ber  68],  Peterson  and  Weldon  [Pet  72]. 

From  the  above  minimum  distance  property,  an  (n,  k)  RS  code  with  bounded 
distance  decoding  will  correct  up  to  e  =  n  —  k  erasures  out  of  n  symbols  or  up 
to  t  =  [(n  -  k)  /2J  errors  out  of  n  symbols.  More  generally,  it  will  correct  any 
combination  of  e  erasures  and  t  errors  provided  that  2r  +  e  does  not  exceed  n  —  k. 


3.2  Perfect  Side  Information 


Since  the  RS  code  can  correct  twice  as  many  erasures  as  errors,  it  can  be 


expected  that  the  multiple-access  capability  of  frequency-hop  packet  radio  net¬ 
works  is  considerably  enhanced  if  the  receiver  can  determine  which  symbols  in 
the  packet  have  been  hit.  This  information,  typically  called  side  information, 
is  used  in  the  demodulator  and  decoder  to  improve  error  control.  The  received 
symbols  that  have  been  hit  by  other  transmissions  are  erased  in  order  to  take 
advantage  of  the  powerful  erasure  correction  capability  of  RS  codes.  An  ( n,k ) 
RS  code  can  correct  any  pattern  of  n  —  k  or  fewer  erasures. 

We  consider  the  spread-spectrum  frequency-hopping  model  described  in  Chap¬ 
ter  I.  If  there  are  I  users  transmitting,  we  model  it  as  an  I  user  interference 
channel.  We  assume  that  the  background  noise  is  negligible  compared  to  the 
signal  power  and  perfect  side  information  is  available  to  the  demodulator  and 
decoder.  However,  these  assumptions  will  be  relaxed  in  chapter  V.  The  main  pur¬ 
pose  of  the  present  section  is  to  examine  the  improved  multiple-access  capability 
available  through  the  use  of  frequency-hopping  with  perfect  side  information  and 
erasure  correction. 

3.2.1  Assumption  1:  No  Discrimination  Against  Partially  Overlapping 

Interference 


We  assume  first  that  all  symbols  that  have  been  hit,  even  if  only  partially  over¬ 
lapping  in  time  (due  to  the  asynchronous  nature  of  frequency  hopping  process), 
are  detected  and  erased.  When  there  are  /  simultaneous  users  the  probability 
that  a  particular  symbol  is  hit  is  given  by  Pkj  (see  (1.2)),  The  marginal  transition 
probability  in  this  case  is  given  by 


P(y,|x  i,x2,---,z/) 


1  ~  Pkj,  Vi  =  *} 
Pkj,  y,  =?. 


Since  the  jt>%  channel  output  does  not  depend  on  the  symbols  transmitted  from 
other  users,  the  interference  channnel  is  separated.  The  component  channel 


5 
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Figure  3.1:  Af-ary  erasure  channel. 

model  (seen  by  each  user  pair)  will  be  an  Af-ary  erasure  channel  with  erasure 
probability  equal  to  p^i  as  shown  in  Figure  3.1. 

Achievable  Region 


A  given  codeword  (packet)  is  correctly  received  if  the  number  of  erasures 
does  not  exceed  the  erasure-correction  capability  of  the  RS  code.  By  the  memo- 
rylessness  of  the  random  hopping  pattern,  the  hits  at  different  hop  durations  are 
conditionally  independent  given  I.  Thus  the  probability  of  correct  codeword  for 
a  bounded  distance  decoder  given  I  simultaneous  transmissions,  Fc(7),  is  given 


Pc(I)  =  £  ^  j  4/(1 -PM)"-.  (3.3) 

Asymptotically,  as  n  and  k  approach  infinity  while  the  code  rate,  r  —  k/n,  is 


K 
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held  constant,  it  can  be  shown  (see  Appendix  A)  that 

1,  1  -  r  >  ph  I 

.5“^“'  0.5,  1  -r  =  pkJ  (3.4) 

0,  1  -  r  <  phl. 

This  implies  that  “error-free”  communication  is  possible  asymptotically  provided 
that  the  code  rate  is  less  than  1  -  ph  n  i.e., 


or  equivalently 


r  <  (1  -  P*)7'1, 


/<  1  + 


ln(l  -  pk)  ■ 

This  represents  an  asymptotic  (n,k  — ►  oo)  achievable  region  of  I  and  r  for  arbi¬ 
trarily  small  error  probability  with  perfect  side  information.  The  limiting  value 
for  the  asymptotic  achievable  region  as  both  the  number  of  users  and  the  number 
of  frequency  slots  get  large  (i.e.,  /,  q  — ►  oo  with  \  =  I/q  held  constant)  is  given 


r  <  t 


A  <  iln(i), 
n  r 


where 


synchronous  frequency  hopping 


{  1  +  asynchronous  frequency  hopping. 

It  can  be  easily  shown  that  the  capacity  of  the  component  channel  shown  in 
Figure  3.1  is  given  by 

C(f)  =  1  -  PK, 

=  (1 

which  is  the  same  as  the  right  hand  side  of  (3.5).  This  implies  that  the  capacity  of 
the  channel  with  perfect  side  information  can  be  achieved  by  the  Reed-Solomon 
code. 
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Now  we  consider  the  achievable  region  for  finite  block  length  Reed-Solomon 
codes.  We  want  to  find  the  maximum  number  of  simultaneous  transmissions 
(or  channel  traffic)  and  the  maximum  code  rate  for  the  packet  error  probability 
to  be  less  than  PE  when  Reed-Solomon  codes  of  finite  block  length  are  used  to 
correct  the  erasures  due  to  the  multi-user  interferences.  Unfortunately  it  is  very 
difficult  to  derive  the  exact  maximums  analytically,  because  (3.3)  is  a  complicated 
function  of  I  and  k.  However,  we  can  derive  a  simple  approximation  to  the 
maximum  channel  traffic  and  code  rate  as  follows.  If  we  apply  the  Demoivre- 
Laplace  theorem  [Pap  65]  to  (3.3),  we  can  get  an  approximation 


Pc(I)  *  F 


n-k-  nphJ  \ 

\Jnph,i{l  -  Ph.i)  J 


(3.10) 


't 


s 


3 


V* 


£ 


where 


F(x)  =  [  (2i r)  »e  U^ldu. 

7-00 

V 

s». „ 

By  combining  (3.10)  with  the  constraint,  PE(I )  =  1  -  Pe(/)  <  Pe, 

we  obtain 

rw 

r  <  1  -  Ph,i  ~  ayjpk,i(l  -  Ph,i)/n 

(3.11) 

8 

or  equivalently 

- 

(3.12) 

5 

ys 

where 

** 

* 

a  =  _ 

.  A  2nr+a8-fay/4nr(l-r)+aa 
A  ~~  2(n+a*) 

Figure  3.2  shows  the  achievable  regions  of  I  and  r  for  PE{I )  <  10-2  with  Reed- 
Solomon  codes  of  length  32  and  256  and  also  the  asymptotic  achievable  regions 
for  arbitrarily  small  error  probability  with  perfect  side  information.  We  see  that 
the  exact  values  and  the  approximations  are  very  close,  where  the  exact  values 


v- 

>. 


have  been  obtained  by  computer  search. 
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When  there  is  a  distribution  on  the  number  of  packet  transmissions  (Poisson 
with  mean  G),  we  have  the  average  probability  of  correct  decoding,  Pc,  given  by 


Pc  =  EPc(I  +  l)f(I), 

l=o 


(3.13) 


where 


/(/)  =  GVC//!. 


It  is  shown  in  (Pur  84)  that  as  G  and  q  approach  infinity  while  p.  =  G/q  is  held 


constant, 


Pc  =  E  (l-e-,'‘)i(e-"T“/, 

j=0  J  , 


(3.14) 


where  rj  is  given  by  (3.9).  By  applying  the  Gaussian  approximation  of  (3.14)  to 


the  constraint,  PE  =  1  -  Pc  <  PEi  we  obtain 


r  <  e~ni‘  -  ay/e-^i  1  -  e"'»*)/n, 


(3.15) 


or  equivalently 


M  <  -ln(l/A). 


(3.16) 


Equations  (3.11)  and  (3.12)  will  be  especially  useful  for  the  use  of  adaptive 


transmissions  and  coding  techniques.  The  idea  is  to  observe  the  channel  and 


respond  to  an  unfavorable  channel  (e.g.  heavy  traffic)  by  controlling  the  channel 
traffic  level  (restricting  the  number  of  packet  transmissions  according  to  (3.12)) 
or  by  improving  the  error-correction  capability  of  the  system  (reducing  the  code 
rate  according  to  (3.11))  such  that  the  packet  error  probability  on  the  individual 


communication  links  is  less  than  some  desired  value,  PE.  Estimation  of  channel 


traffic  is  fairly  easy  to  implement  in  a  frequency-hop  radio  network  [Pur  83a). 


Perhaps  the  simplest  estimate  of  channel  traffic  is  the  number  of  frequency  slots 


that  have  signal  strengths  above  a  certain  threshold.  Another  alternative  is  to 


monitor  a  few  of  the  frequency  slots  and  count  the  number  of  times  signals  are 


present  on  these  slots  during  a  few  hop  periods. 
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Throughput 


For  a  system  employing  an  ( n,k )  code  and  q  frequency  slots,  the  normalized 
throughput  given  I  simultaneous  transmissions  is  given  by 


W  = 


(3.17) 


The  asymptotic  normalized  throughput  as  n  and  k  approach  infinity  while  r  = 
k/n  is  held  constant  can  be  obtained  by  using  (3.6)  and  (3.17)  as 


lim 

n,k—>oo 


Mr)  \ 

ln(l  -pk)J  ' 


(3.18) 


This  means  that  the  asymptotic  normalized  throughput  approaches  arbitrarily 
close  to  the  RHS  of  (3.18).  The  unit  of  the  above  normalized  throughput  is  infor¬ 
mation  symbols  per  channel  use  per  frequency  slot.  To  change  it  to  information 
bits  per  channel  use  per  dimension,  it  must  be  multiplied  by  log2  M/D,  where  D 
is  the  dimensionality  of  the  signal  set  per  frequency  slot.  In  all  that  follows  we 
will  consider  the  former  unit:  information  symbols  per  channel  use  per  frequency 
slot. 

By  optimizing  over  r,  we  get  the  optimum  code  rate,  ropt,  given  by 


r  opt  —  c  (l  Ph)  > 


(3.19) 


which  for  reasonable  values  of  q  is  very  close  to  e-1.  This  asymptotic  optimal 
code  rate  also  seems  to  give  a  very  good  approximation  to  the  optimal  code  rate 
for  finite  length  codes,  even  the  length  32  codes.  We  can  see  from  Figures  3.3  and 
3.4  that  the  maximum  normalized  throughput  is  obtained  by  the  (32,12)  code 
and  (256,94)  code:  but  the  optimum  values  of  k  obtained  from  the  asymptotic 
optimum  code  rate,  e-1,  are  32  x  e-1  =  11.77  and  256  x  e-1  =  94.18,  which  are 
very  close  to  the  exact  optimum  values  of  k,  namely  12  and  94  respectively.  At 
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Figure  3.3: 
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Normalized  throughputs,  perfect  side  information,  q  = 
100,  n  =  32,  r?=2. 


Figure  3.4:  Normalized  throughputs,  perfect  side  information,  q 
100,  n  =  256,  *7=2. 


this  optimum  code  rate  the  optimum  number  of  transmissions  is  given  by 


lopt  =  [ln(l  —  Pk)-1]-1,  (3.20) 

thus  the  limiting  optimum  value  of  the  channel  traffic  per  frequency  slot,  A  =  I/q, 
is 

Kpt  =  »T\  (3.21) 

a s  q  —*  oo.  At  ropt  and  Iopt  the  maximum  possible  throughput,  Wmaz  becomes 

W'mu,  =  l/[qt{\  -  pk)  ln(l  -  p*)'1],  (3-22) 

which  approaches  e-1/7?  f°r  large  enough  q.  This  is  also  the  asymptotic  sum 
capacity  of  the  interference  channel  with  perfect  side  information  in  information 
symbols  per  channel  use  [Haj  83],  (Heg  85].  Therefore  it  can  be  concluded  that  if 
perfect  side  information  is  available,  the  asymptotic  sum  capacity  is  achieved  by 
the  optimal  rate  Reed-Solomon  code  with  bounded  distance  decoding.  However, 
this  is  not  true  if  side  information  is  not  available  as  we  will  see  in  section  3.3. 

Comparisions  With  Narrowband  Slotted  ALOHA  System 


For  Poisson  traffic  model  (the  number  of  packet  transmissions  in  a  time  slot 
is  given  by  a  Poisson  random  variable)  and  slotted  ALOHA  [Tan  81]  without 
frequency  hopping,  the  optimum  average  number  of  transmissions  attempted 
per  time  (packet)  slot  is  1.  The  throughput  at  this  traffic  level  is  e"\  and  the 
resulting  packet  error  probability  is  1-e-1  which  is  approximately  0.632  [Abr  70], 
[Tan  81]. 

For  frequency-hop  radio  networks  with  error-control  coding  (RS  code  with 
perfect  side  information)  and  Poission  traffic,  the  normalized  throughput  can  be 
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derived  as 


_  k  r^oo 


££r=0  iP'{i)f{i) 


=  i  Er=o /  E"=0*  (1  -  (1  -  pj»)/-1)j((i  -  PkV~l)n~3 *f=Z 

J 


=  i  •  f  £/°°=0  E?=0  (1  -  (1  -  P*)')'((l  -  P,)7)n-;  fifff 


(3.23) 


7*  E?=o 

,  i 


as  G,?  -*  oo,  while  n  =  Gjq  is  held  constant.  From  (3.4),  as  n,k  -*  oo  while 


r  =  fc/n  is  held  constant,  we  can  show  that  the  summation  term  approaches  1  if 


r  <  e~r"i.  Therefore  the  normalized  throughput  becomes 


W  —  ne 


(3.24) 


as  n,k,G,q  — »  oo.  The  optimum  traffic  level  can  be  shown  to  be  rj~l  and  the 
throughput  at  this  optimum  traffic  level  is  e~l/rj:  for  synchronous  frequency 
hopping  rj  =  1,  and  even  for  asynchronous  frequency  hopping  rj  can  be  1  asymp¬ 
totically  by  forming  each  M-ary  symbol  from  binary  signals  (e.g.  BFSK)  of 
length  logj  M  bits,  and  thus  making  =  log2A/  in  (3.9).  Therefore,  it  can 


be  concluded  that  frequency-hop  spread-spectrum  modulation  can  be  just  as 


bandwidth-efficient  as  narrowband  modulation  in  the  sense  that  for  a  given  band¬ 


width  it  can  achieve  the  same  throughput.  However,  for  the  narrowband  ALOHA 


system  without  frequency  hopping  the  throughput  of  t  1  is  achieved  when  the 


packet  error  probability  is  0.632  (which  may  be  too  large  in  practical  system)  and 


with  binary  feedback,  while  for  the  spread-spectrum  modulation  it  is  achieved 


with  arbitrarily  small  packet  error  probability  and  without  feedback.  Error- 


control  coding  can  not  improve  the  situation  very  much  (if  at  all)  in  the  nar¬ 


rowband  ALOHA  system,  because  the  symbol  error  probability  is  approximately 


1/2  for  M-ary  signal  set  of  interest  whenever  the  symbol  is  hit  by  another  trans¬ 
mission  of  equal  power.  Thus  the  average  number  of  errors  within  the  received 
version  of  a  codeword  (packet)  of  length  n  will  be  approximately  n/2,  while  for 
any  (n,k)  code  the  maximum  number  of  correctable  errors  is  [(n  -  k)/2\.  This 
implies  that  coding  can  hardly  improve  the  performance  of  narrowband  ALOHA 
system.  Numerical  datas  given  in  [Haj  82)  support  the  above  arguments. 

3.2.2  Assumption  2:  Discrimination  Against  Partially  Overlapping  Interference 

In  this  section  we  assume  the  use  of  noncoherent  M- ary  FSK  signaling  (each 
frequency  slot  thus  consists  of  M  orthogonal  tone  positions),  and  assume  that 
the  packet  radio  network  operates  asynchronously  at  the  hop  level  (asynchronous 
frequency  hopping).  Then  the  occurence  of  hits  generally  results  in  partial,  rather 
than  total,  overlap  among  tones  of  different  users;  it  is  assumed  that  the  degree 
of  overlap  in  time  experienced  by  any  pair  of  hops  that  suffer  a  hit  is  uniformly 
distributed  over  the  interval  from  0  to  the  total  hop  duration  time,  Th.  Without 
loss  of  generality  we  assume  Th=l.  It  was  assumed  in  subsection  3.2.1  that  any 
degree  of  hop  overlap  results  in  the  loss  of  the  information  (erasure)  carried  in 
that  hop.  In  this  subsection  we  make  a  departure  from  this  assumption. 

We  assume  that  a  symbol  erasure  will  be  necessitated  if  and  only  if  in  any 
one  (or  more)  of  the  M  tone  positions  of  the  frequency  slot  the  amount  of  time 
overlap  between  the  symbol  (tone)  of  interest  and  those  of  other  users  exceed  a 
fraction  p  of  the  hop  duration  time.  Otherwise,  the  symbol  is  received  correctly. 
This  modified  model  in  which  partial  overlaps  can  be  tolerated  was  introduced 
in  [Wie  84). 

Therefore  we  must  examine  each  of  the  M  tone  positions  of  the  frequency 
slot  to  determine  whether  any  of  them  experience  interference  for  more  than  a 
fraction  p  of  the  hop  duration.  Note  that  this  interference  may  arise  from  one  or 
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more  other  users’  signals  in  the  same  tone  position  whose  combined  overlap  at 
the  same  or  at  opposite  ends  of  the  hop  lasts  for  a  fraction  of  a  hop  greater  than 
p.  However,  it  is  shown  in  Appendix  B  that  as  M  becomes  large,  the  probability 
of  the  event  that  all  users  sharing  the  same  frequency  slot  transmit  distinct  tones 
approaches  1.  Therefore  if  r  denotes  the  amount  of  time  overlap  between  the 
tone  of  interest  and  that  of  an  interferer,  the  probability  of  symbol  erasure  given 
m  hits,  Pm,  is  given  by 


Pm  =  1  —  [P(t  <  p)]m 

=  1  -  pm. 


(3.25) 


Thus,  by  averaging  over  the  number  of  hits  we  obtain  the  symbol  erasure  prob¬ 
ability,  pp  /,  given  as 


/ 


P,.i  =  EiT=x(l-pm) 


I  -  1 
m 


\ 


V 


p)T(i  -  pO 


1  - 1  -m 


(3.26) 


The  marginal  transition  probability  in  this  case  is  given  by 


P{yj\xux^"‘  >*i) 


1  -  Pp,/. 

Vi  = 

Pf,l> 

£ 

II 

Since  the  jth  channel  output  does  not  depend  on  the  symbols  transmitted  from 
other  users,  the  interference  channnel  is  separated.  The  component  channel 
model  is  again  M-ary  erasure  channel,  but  with  erasure  probability  equal  to  p9 


Achievable  Region 


By  following  the  same  procedure  as  in  subsection  3.2.1,  we  can  show  that 
“error-free”  communication  is  possible  asymptotically  provided  that  the  code 
rate  is  less  than  1  -  p,,/,  i.e., 

r  <(l-(l-p)p„)'-1,  (3.27) 
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or  equivalently, 


I  <  1  + 


ln(r) 


ln(l  -  (1  -  p)pK) 


(3.28) 


Throughput 


By  following  the  same  procedure  as  in  subsection  3.2.1,  the  asymptotic  nor¬ 
malized  throughput  as  n  and  k  approach  infinity  while  r  =  k/n  is  held  constant 
can  be  shown  to  be 

ln(r) 


lim  W  =  -( 

»,*—oo  q  \ 


1  + 


ln(l  -  (1  -  p)pk)J  ' 

By  optimizing  over  r,  we  get  the  optimum  code  rate,  ropt ,  given  by 


(3.29) 


ropt  =  «-1(l  -  (1  -p)pk)~\ 


(3.30) 


which  for  reasonable  values  of  q  is  very  close  to  e-1.  At  this  optimum  code  rate 
the  optimum  number  of  transmissions  is  given  by 


Ion  =  [ln(l  -  (1  -  p)pk) 


-n-i 


(3.31) 


thus  the  limiting  (/,  q  — *  oo  with  A  =  I/q  held  constant)  optimum  traffic  intensity 
per  frequency  slot,  A^j,  is  given  by 


Kt  =  1/W1  —  /»)]- 


(3.32) 
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At  ropt  and  1^  the  asymptotic  maximum  possible  throughput,  Wmat,  becomes 

W. m >  =  l/[?e(l  ~  (1  “  p)Pk)  ln(l  -  (1  -  p)ph)-1],  (3.33) 

which  approaches  —  p)\  for  larg«  enough  q.  This  is  also  the  asymptotic 

sum  capacity  of  the  interference  channel  as  modeled  by  A/-ary  erasure  component 
channels  with  erasure  probability,  ppj,  given  in  (3.26).  We  see  that  the  ability  to 
discriminate  against  interfering  signals  results  in  dramatic  increase  in  throughput 
by  the  factor  of  1/(1  -p). 
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3.3  No  Side  Information 


We  now  assume  that  side  information  is  not  available  at  the  demodulator, 
thus  it  does  not  produce  any  erasure  symbol,  but  instead  makes  an  estimate 
(hard  decision)  on  the  received  signal.  The  demodulated  symbols  are  fed  into  an 
error-correction  decoder.  As  long  as  there  are  no  more  than  [^y^J  errors,  the 
[n,k)  RS  code  can  correct  them,  where  [xj  denotes  the  integer  part  of  x. 

3.3.1  Demodulator  Model  1:  Worst  Case 


i 

i 


v; 

V, 

V 


S’ 

y 


We  assume  that  if  a  received  symbol  is  hit  by  one  or  more  symbols,  then  the 
demodulator  output  is  equally  likely  one  of  the  M  possible  symbols,  and  if  there 
is  no  hit  it  is  correctly  received.  That  is,  the  conditional  probability  of  symbol 
error  given  hit  is  given  by  1  —  1/M,  and  it  is  0  given  no  hit.  Thus  the  probability 
that  a  received  symbol  is  in  error  given  I  simultaneous  transmissions,  ptj ,  is 
given  by 

pt./  =  (l-l/M)(l-(l-pfc)/-1).  (3.34) 


This  is  the  worst  case  assumption  in  the  sense  of  minimizing  the  capacity:  The 
minimum  of  the  capacity  of  an  M- ary  channel  is  obtained  when  all  the  transition 
probabilities  are  equal  to  l/M,  and  the  resulting  minimum  capacity  can  be  shown 
to  be  zero.  Therefore,  the  resulting  achievable  regions  and  throughputs  are 
pessimistic  results. 

The  marginal  transition  probability  in  this  case  is  given  by 


P(y,|xi,  *2.  •••>*/) 


1  Pt,Ii  Vj  ~  x) 

pt.i ,  y>  #  xj- 


Since  the  jth  channel  output  does  not  depend  on  the  symbols  transmitted  from 
other  users,  the  interference  channnel  is  separated.  The  component  channel 


M-l  ^ 


vJ  (M-l) 


^/(M-l) 


Figure  3.5:  M-ary  symmetric  channel. 

model  will  be  an  M-ary  symmetric  channel  with  crossing  probability  ptj  as 
shown  in  Figure  3.5. 

Achievable  Region 

When  an  (n,  k)  Reed-Solomon  code  is  employed  to  correct  the  errors,  the 
probability  of  correctly  decoding  a  codeword  (packet)  given  I  simultaneous  trans¬ 
missions,  Pe(7),  with  bounded  distance  decoding  is  given  by 


L("-*)/iJ  n 

Pc{I)=  £  <;(1  -Pt, 

>=°  j 


(3.35) 


Asymptotically,  as  n  and  k  approach  infinity  while  the  code  rate,  r  =  k/n,  is 


held  constant,  it  can  be  shown  that 


1,  1  -  r  >  2 ptj 


lim  P t(7)  =  0.5,  1  -  r  =  2 ptJ 

»,«-»00  I 


(3.36) 


0,  1  -  r  <  2 P'j. 
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This  implies  that  “error-free”  communication  is  possible  asymptotically  provided 
that  the  code  rate  is  less  than  1  —  2 pt  j,  i.e., 


or  equivalently 


r  <  2(1  -  p*)'-1  -  1, 


/<i  +  !!lElM 

ln(l  -  pk) 


(3.37) 


(3.38) 


This  represents  an  asymptotic  achievable  region  of  I  and  r  for  arbitrarily  small 
error  probability  without  side  information.  The  limiting  value  for  the  asymptotic 
achievable  region  as  both  the  number  of  users  and  the  number  of  frequency  slots 
get  large  (i.e.,  /,  q  — *  oo  with  A  =  I fq  held  constant)  is  given  by 


or  equivalently 


r  <  2e~nX  -  1, 


A  <  -  ln(— ^— ). 
r)  V1  +  r’ 


It  can  be  shown  that  as  M  — *  oo,  the  capacity  of  the  channel  shown  in  Figure 


3.5  is  given  by 


which  is  the  same  as  that  obtainable  with  perfect  side  information. 

For  the  case  of  finite  block  length  codes,  we  can  derive  a  similar  approximation 
to  the  maximum  channel  traffic  and  code  rate  for  the  packet  error  probability  to 
be  less  than  Pe ■  By  applying  the  Demoivre- Laplace  theorem  to  (3.35),  we  can 


get  an  approximation 


Pe(/)  »  F 


[(n  -  k)/2\  -  npej 

\/npt,i{  1  -  P*.i) 


(3.39) 


By  combining  (3.39)  with  the  constraint,  Pe{I )  =  1  —  Pe(/)  <  Pe ,  obtain 


r  <  1  -  -  \nptJ  +  as]nptJ(  1  -  ptJ)] 


(3.40) 
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where 


/  <  1  +  ln(£)/In(l  -  pK) 


^4  ^  2 1  +  a2  —  a.\jAt  +  a2  —  At2 /n 


(3.41) 


2(1  —  1/M)(n  +  a2) 

Figure  3.6  shows  the  achievable  regions  of  I  and  r  for  PE(I )  <  10_J  with  Reed- 
Solomon  codes  of  length  32  and  256  and  also  the  asymptotic  achievable  regions 
for  arbitrarily  small  error  probability  without  side  information.  We  see  that  the 
exact  values  and  the  approximations  are  very  close. 

When  there  is  a  distribution  on  the  number  of  packet  transmissions  (Poisson 
with  mean  G),  it  can  be  shown  that 

Pc=  E  ”  [(1  -  1/M)(1  —  e~'M*)],[l  —  (1  —  1/M)(1  —  e~nii)}n~\  (3.42) 

J=°  l  >  ) 

as  G  and  q  approach  infinity  while  p  =  G/q  is  held  constant.  By  applying  the 
Gaussian  approximation  of  (3.42)  to  the  constraint,  PE  <  Pe,  we  can  obtain 


or  equivalently 


where 


r  <  1 - \np'%^  +  aJnpt<hl{\  -pe,„)l, 

n 


M  <  -  ln(l /£), 
*7 


p<lM  =  (l-l/M)(l-e-'"‘). 


(3.43) 


(3.44) 


As  in  perfect  side  information  case,  the  equations  (3.40)and  (3.41)  will  be 
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useful  for  the  use  of  adaptive  transmissions  and  coding  techniques. 


Throughput 


The  asymptotic  normalized  throughput  can  be  obtained  from  (3.17)  and 
(3.38)  as 

for  large  enough  q.  By  optimizing  over  r  we  get  the  optimal  code  rate,  ropt 


(3.45) 


r  opt  =  0.4597.  (3.46) 

This  asymptotic  optimal  code  rate  also  seems  to  give  a  very  good  approximation 
for  finite  length  codes,  even  the  length  32  codes.  We  can  see  from  Figures  3.7  and 
3.8  that  the  maximum  normalized  throughput  is  obtained  by  the  (32,14)  code  and 
(256,118)  code:  the  optimum  values  of  k  obtained  from  the  asymptotic  optimum 
code  rate,  0.4597,  are  32  x  0.4597  =  14.71  and  256  x  0.4597  =  117.68,  which  are 
very  close  to  the  exact  optimum  values  of  k,  namely  14  and  118  respectively. 
At  this  optimum  code  rate  the  optimum  channel  traffic  per  frequency  slot,  Aop(, 
is 

Aop<  =  0.3148/q,  (3.47) 

which  is  also  a  good  approximation  for  finite  n  and  q.  At  ropt  and  Aopf  the 
asymptotic  maximum  possible  throughput,  Wmax,  becomes 


Wmat  =  0.1448/ q,  (3.48) 

which  is  only  39.3%  of  that  achievable  with  perfect  side  information. 

We  can  also  show  that  the  asymptotic  ( I,q  — »  00)  maximum  sum  capacity 
without  side  information  approaches  t~x  jr\  as  M  — *  00.  The  loss  in  using  Reed- 
Solomon  codes  is  partially  due  to  the  use  of  a  non  maximum  likelihood  decoder 
(i.e.,  bounded  distance  decoder).  However,  we  will  show  in  chapter  IV  that  the 
normalized  throughput  achievable  with  perfect  side  information  can  be  achieved 
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through  the  use  of  concatenated  coding  scheme,  even  though  the  channel  provides 


no  side  information. 


3.3.2  Demodulator  Model  2:  Realistic  Case 


Notice  that  in  the  previous  model  we  have  not  distinguished  one  hit  from 


more  than  one  hit  in  the  calculation  of  pej.  This  can  be  taken  into  account  as 


follows.  If  two  users  hop  to  the  same  frequency  slot  at  the  same  time,  i.e.  one  hit, 


the  probability  of  symbol  error  is  1/2  if  the  two  users  have  different  symbol  and 
0  if  they  have  the  same  symbol.  If  three  users  collide,  i.e.  two  hits,  the  symbol 
error  probability  is  2/3  if  all  three  users  transmit  different  symbols,  and  1/2  if 
two  of  the  users  transmit  the  same  symbol  but  the  third  transmits  a  different 
symbol,  and  0  if  they  have  the  same  symbol.  This  modeling  is  valid  for  the  M- 
orthogonal  signaling,  such  as  MFSK.  Notice  that  the  jth  channel  output  depends 
on  the  symbols  transmitted  from  other  users.  Therefore,  the  interference  channel 


in  this  case  is  not  separated. 


If  each  symbol  is  transmitted  with  equal  probability,  i.e.,  1/M,  then  the 
probability  of  symbol  error  for  this  situation  with  m  hits,  Pm ,  can  be  derived  as 
(see  Appendix  B) 

=  0*  + 1(1  -  £>  =  iCV) 

p  -  I  .  UIM-1)  .  ■■ 

■*2  —  '  2  M3  '  3  M3  6  M3 


P  _ 

■*3  —  ik/3 


Pi  = 


_  74M*  —  ISM3  -  10A-T3  + 1 

“  30  M* 


(3.49) 
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As  M  becomes  larger,  Pm  becomes 


Pm  =  m/{m  +  1). 


(3.50) 
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That  is,  the  probability  of  symbol  error  tends  to  depend  more  on  the  number  of 


interfering  signals  than  on  which  symbols  are  being  transmitted  from  interferes 


as  M  becomes  large.  The  above  probability  is  also  an  upper  bound  for  finite 


M ,  and  can  also  be  used  as  a  good  approximation:  for  example,  P4=0.784  for 


M= 32  and  0.798  for  M= 256,  while  the  upper  bound  is  0.8.  By  averaging  over 


the  number  of  hits  we  can  determine  the  average  symbol  error  probability  given 


I  simultaneous  transmissions,  pt  I ,  as 


p.j  =  eSAjSi  7  1  pr(i-p^)/-1-m 


(3.51) 


=  1  - 


Jp* 


Achievable  Region 


From  (3.36)  and  (3.51)  we  can  show  that  asymptotically  as  n,  k  -*  oo  while 


r  =  k/n  is  held  constant,  “error-free”  communication  is  possible,  i.e,  Pe(/)  =  1, 


provided 


r  < 


(3.52) 


as  I,q  -»  oo  while  A  =  I/q  is  held  constant.  Figure  3.9  shows  the  asymptotic 
achievable  regions  of  code  rate  and  number  of  packet  transmissions  for  arbitrarily 
small  packet  error  probability  for  the  cases  of  perfect  side  information  and  no 


side  information. 


Throughput 


From  (3.17)  and  (3.52)  the  asymptotic  normalized  throughput  can  be  shown 
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to  be 


w  =  j  - 1) 


5(1-  a, 


(3.53) 


as  /,<?—►  oo  while  A  =  I/q  is  held  constant.  By  optimizing  over  A  we  get  the 


optimum  channel  traffic,  Aopt 


Aopt  =  ln(2)/»7  =  0.6931/rj, 


(3.54) 


and  the  optimum  code  rate,  ropt 


°P‘  1 


=  ln(«/2)/ln(2)  =  0.4427, 


(3.55) 


and  the  asymptotic  maximum  possible  throughput,  W„ 


wmax  =  ln(e/2)/r?  =  0.3069/»7. 


(3.56) 


However,  the  capacity  region  with  this  model  is  not  known,  because  the  channel 


is  not  separated.  Figure  3.10  shows  the  asymptotic  normalized  throughputs  for 


the  perfect  side  information  and  no  side  information  cases. 
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CHAPTER  IV 


CONCATENATED  CODES 


4.1.  Introduction 


It  has  been  shown  in  Section  3.3  that  the  maximum  throughput  achievable 
without  side  information  is  only  39.3%  (worst  case)  of  that  achievable  with  perfect 
side  information.  This  gives  us  a  quantitative  measure  of  the  importance  of  side 
information  in  improving  the  multiple-access  capability  of  frequency-hop  packet 
radio  networks. 

One  technique  for  obtaining  the  side  information  is  to  partition  the  data 
stream  into  blocks  of  K  digits  and  to  encode  each  block  into  a  codeword  of 
length  N(>  K )  and  to  transmit  the  codeword  during  a  single  hop.  On  the  basis 
of  the  received  version  of  the  codeword  the  decoder  attempts  to  detect  errors  in 
the  received  sequence:  if  there  are  errors  then  at  least  one  code  symbol  must  have 
been  hit.  However,  not  all  error  patterns  are  detectable,  so  there  is  a  nonzero 
probability  of  undetected  error.  If  an  error  is  detected  then  symbols  transmitted 
on  that  hop  are  erased,  and  if  the  error  is  undetected  it  results  in  an  error. 

A  similar  technique  has  been  suggested  by  McEliece  and  Stark  (McE  84]  using 
a  test  pattern,  it  is  however  a  special  example  of  the  class  of  error  detecting 
codes  considered  in  this  chapter,  and  the  underlying  assumption  in  [McE  84]  is 


that  interference  occurs  in  a  whole  block  if  it  occurs:  that  is,  the  interference 
during  a  hop  remains  the  same  throughout  the  hop.  This  assumption  is  very 
restrictive,  and  certainly  many  real  channels  such  as  asynchronous  frequency¬ 
hopping  multi-user  systems  do  not  have  constant  interference  in  the  block.  In 
general,  interference  occurs  partially  during  a  hop. 

One  can  expect  that  as  the  code  rate  decreases,  the  probability  of  undetected 
error  decreases  and  the  probability  of  detected  error  increases  because  of  the 
increased  minimum  distance  among  the  codewords.  That  is,  the  reliability  of  the 
side  information  obtained  from  the  code  increases.  However,  decreasing  the  code 
rate  implies  a  decrease  in  the  efficient  use  of  the  channel.  An  interesting  question 
that  arises  from  this  discussion  is  “How  does  the  reliability  of  the  side  information 
change  as  the  code  rate  changes?”,  or  “What  is  the  maximum  allowable  code  rate 
to  obtain  a  certain  reliability  of  the  side  information?”.  In  this  chapter  we  give 
the  answer  to  the  above  question  for  both  the  constant  and  partial  interference 
cases. 

The  combination  of  encoder,  channel,  and  decoder  generates  in  general  an 
errors-and-erasures  channel.  The  above  encoder  and  decoder  will  be  called  later 
an  inner  encoder  and  inner  decoder  respectively.  We  employ  an  outer  code  to 
correct  the  errors  (caused  by  undetected  errors)  and  the  erasures  (caused  by  de¬ 
tected  errors).  In  this  way  the  inner  decoder  informs  the  outer  decoder  which 
symbols  (inner  codewords)  in  the  received  packet  have  been  hit  by  symbols  from 
other  packets  in  the  same  time  slot.  We  find  that  the  normalized  throughput 
achievable  with  perfect  side  information  can  be  achieved  through  the  use  of  this 
concatenated  coding  scheme ,  even  though  the  channel  provides  no  side  informa¬ 
tion.  This  chapter  ends  by  evaluating  the  performance  of  diversity  /  RS  code  as 
an  example  of  the  concatenated  coding  schemes. 


4.2.  Concatenated  Coding 


The  basic  concept  of  concatenated  codes  for  two  levels  of  coding  is  illustrated 
in  Figure  4.1.  This  figure  provides  the  general  outline  of  a  powerful  class  of  codes 
which  were  introduced  by  Forney  in  1966  [For  66].  Information  to  be  transmitted 
is  first  encoded  with  an  (n,  k )  outer  code.  The  symbols  from  the  outer  encoder 
are  further  encoded  with  an  (N,  K)  inner  code.  Clearly,  if  the  symbol  alphabets 
of  the  inner  and  outer  codes  are  not  the  same,  it  is  necessary  to  reformat  the 
data  between  the  encoders  for  the  inner  and  outer  codes.  At  the  receive  side,  the 
demodulated  data  is  first  decoded  with  the  inner  decoder,  and  the  symbols  from 
the  inner  decoder  are  then  decoded  with  the  outer  decoder.  The  combination 
of  inner  encoder,  channel,  and  inner  decoder  is  referred  to  as  the  super  channel. 
The  alphabet  sizes  of  the  inner  code  and  outer  code  are  denoted  as  M,  and  M0 
respectively. 

Several  characteristics  of  concatenated  codes  are  evident  from  Figure  4.1. 
First,  the  resulting  concatenated  code  has  overall  length  of  nN  channel  symbols 
(A/,-ary)  with  kK  information  symbols  per  overall  codeword  and  with  code  rate 
rR  =  kK/nN ,  where  R  =  K/N  and  r  =  k/n.  Although  the  overall  length 
of  the  code  is  nN,  the  structure  imposed  by  the  concatenation  concept  allows 
decoding  operation  to  be  performed  by  two  decoders  for  codes  of  length  N  and 
n,  respectively.  This  allows  a  significant  reduction  in  complexity  over  that  which 
would  be  required  to  provide  the  same  overall  error  rate  with  a  single  level  of 
coding.  The  most  natural  choice  for  outer  codes  are  the  RS  codes.  This  is 
because  the  RS  codes,  being  maximum-distance-separable  codes,  make  highly 
efficient  use  of  redundancy,  and  block  lengths  and  symbol  sizes  can  be  readily 
adjusted  to  accomodate  a  wide  range  of  message  sizes. 

The  concatenated  scheme  we  consider  uses  an  inner  code  to  correct  or  detect 
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Figure  4.2:  Super  channel  model  created  by  inner  code. 

errors  within  a  hop.  The  codewords  of  the  inner  code  are  transmitted  during  a 
single  hop  and  one  outer  code  symbol  consists  of  one  inner  codeword  (— ►  M*  = 
M„).  The  inner  code  can  correct  e  errors  and  detect  /  errors  (e  <  /)  provided 
e  4-  /  <  dm(rl,  where  dmin  is  the  minimum  distance  of  the  inner  code  [Mac  77]. 
When  an  error  is  detected  every  symbol  of  the  inner  code  is  erased.  There  are, 
however,  errors  that  are  not  detected  nor  corrected  by  the  inner  code  which 
result  in  errors  at  the  output  of  the  inner  decoder.  Therefore,  the  inner  code 
creates  an  errors-and-erasures  channel,  as  shown  in  Figure  4.2,  where  Pd  and  Pud 
denotes  the  probability  of  detected  error  and  the  probability  of  undetected  error 
respectively.  The  purpose  of  the  outer  code  is  to  correct  the  errors  and  erasures 
of  the  inner  code. 
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Achievable  Region 


Since  an  (n,  k)  RS  outer  code  can  correct  t  errors  and  e  erasures  provided 
c~*~2t  <  n  k,  for  a  memoryless  channel  of  Figure  4.2  the  probability  of  correctly 
decoding  a  codeword  (packet)  is  given  by  [Ber  80] 


p.(i)  =  E 

<+2m<n-fc 


<  n  ' 


l,  m 


Pd  O  1  ~Pd~  Pud) 


n—l  —  m 


(4.1) 


where 


/  ^ 

n 


/,  m 


n: 


/!m!(n  —  l  —  m) ! 

Asymptotically  as  both  n  and  k  approach  infinity  while  the  outer  code  rate 

r  —  kjn  is  held  constant,  it  can  be  shown  (see  Appendix  C)  that 

r 

1,  r  <  1  —  Pd  -  2Pud 

n.fe'oo  Pe(/)  =  0-5>  T=l-Pd-  2 Pud  (4.2) 

0,  r  >  1  -  Pd  -  2 Pud. 

That  is,  “error- free”  communication  is  possible  asymptotically  provided 


r  <  1  -  Pd  -  2 P^.  (4.3) 

This  is  the  requirement  on  the  outer  code  rate  to  have  error-free  communications. 
To  get  the  requirement  on  the  overall  code  rate  we  have  to  multiply  by  the  inner 
code  rate  K/N.  Thus  the  resulting  asymptotic  normalized  achievable  rate  is 
given  by 

rR  <  ~{l  -  Pd  -  2PJ).  (4.4) 

For  the  case  of  finite  block  length  codes,  we  can  derive  an  approximation  to 
the  maximum  channel  traffic  and  the  maximum  code  rate  for  the  packet  error 
probability  to  be  less  than  Pe-  It  is  shown  in  Appendix  C  that 

v/n(l  -  r  -  PA  -  2Pud)  ^ 


Pc(I)  «  F 


sjPd  ~  P\  +  4 Pud  ~  4 Pld  -  4 PdPud  j  ' 


(4.5) 
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By  combining  (4.5)  with  the  constraint,  PE(I )  =  1  -  PC{I)  <  PE,  we  obtain 

r<i-Pd-2Pud-  a\/{P d  -  P}  +  4  Pud  -  4  Pld  -  4  PdPud)/n,  (4.6) 

where  a  is  defined  in  (3.12).  This  is  the  constraint  on  the  outer  code  rate  for  the 
packet  error  probability  to  be  less  than  PE  for  a  given  inner  code  and  the  channel 
(number  of  simultaneous  transmissions).  Thus  the  normalized  achievable  region 
is  given  by 

rR  <  ^[1  -  Pd  -  2 Pud  -  asJ{Pd  -  P\  +  iPud  -  4 J[d  -  4 PdPud)/n\.  (4.7) 

Throughput 


The  normalized  throughput  with  the  concatenated  coding  scheme  is  defined 


by 


k  K 

n  N  a 


(4.8) 


As  both  n  and  k  approach  infinity  while  r  =  k/n  is  held  constant,  from  (4.3)  and 

(4.8)  the  asymptotic  normalized  throughput  is  given  by 


I 


lim 

n,k—oo 


7(1  -  Pd  -  2 Pud) 
<7 


(4.9) 


Pd  and  Pud  are  determined  by  the  inner  code  and  the  channel.  Note  that  the 
achievable  regions  and  the  throughput  derived  in  this  section  are  general  enough 
to  be  applied  to  any  combinations  of  inner  block  codes  and  RS  outer  codes. 

4.3.  Error  Detecting  Code  /  RS  Code 

In  this  section  we  assume  that  the  receiver  does  not  have  side  information 
concerning  the  presence  of  hit.  However  we  try  to  get  the  side  information  by 
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detecting  the  errors  in  each  hop  caused  by  the  multi-user  interference  through 
the  use  of  binary  error  detecting  code  (Mi  =  2).  The  idea  is  to  encode  a  block  of 
K  data  bits  into  a  block  of  N  bits  and  to  transmit  the  N  bits  during  a  single  hop, 
and  on  the  basis  of  the  received  version  of  the  transmitted  codeword  to  detect  the 
errors  caused  by  interference.  If  an  error  is  detected  the  entire  N  bits  transmitted 
on  that  hop  are  erased.  However  not  all  error  patterns  are  detectable  so  there 
is  a  nonzero  probability  of  undetected  error.  We  employ  an  RS  outer  code  to 
“correct”  the  errors  (caused  by  undetected  errors)  and  the  erasures  (caused  by 
detected  errors). 

The  multi-user  interference  level  during  a  hop  may  or  may  not  remain  con¬ 
stant  throughout  the  hop  depending  on  the  availability  of  synchronism  at  the  hop 
level.  If  all  transmitters  adjust  their  timings  of  frequency  changes  such  that  their 
changes  occur  simultaneously  at  each  hop  ( synchronous  frequency  hopping),  the 
multi-user  interference  level  during  a  hop  will  remain  the  same  throughout  the 
hop.  This  model  matches  also  certain  real  channels  such  as  partial-band  jammed 
channel.  However,  for  the  asynchronous  frequency  hopping  multi-user  systems 
where  the  timings  of  frequency  changes  do  not  occur  simultaneously,  the  multi¬ 
user  interference  level  will  not  remain  constant  throughout  the  hop.  For  both 
the  synchronous  and  asynchronous  frequency  hopping  multi-user  systems,  we  in¬ 
vestigate  the  concatenated  coding  scheme  that  employs  a  binary  error  detecting 
code  and  Reed-Solomon  code. 

4.3.1.  Synchronous  Frequency-Hopping  System 

We  assume  that  the  synchronization  at  the  hop  level  is  maintained  by  all  users 
so  that  the  multi-user  interference  level  during  a  hop  remains  the  same  through¬ 
out  the  hop.  Since  the  interference  from  the  other  users’  packet  transmissions 


passes  through  the  dehopper  and  then  is  filtered,  only  the  interference  at  the 
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Figure  4.3:  Component  channel  for  a  simple  interference  channel. 

frequency  of  the  signal  affects  the  performance.  We  assume  that  the  hopping 
pattern  is  essentially  random,  which  makes  the  multi-user  interference  during  a 
hop  be  independent  of  the  interference  at  other  hop  intervals. 

In  each  hop  we  have  two  possibilities:  hit  or  no  hit.  When  the  signal  is  hit 
we  have  fixed  bit  error  probability  of  1/2  for  all  bits  in  the  hop.  When  the  signal 
is  not  hit  the  entire  bits  in  the  hop  are  error-free.  In  both  cases  the  channel 
is  modeled  by  a  binary  symmetric  channel  (BSC)  with  crossing  probabilities 
1/2  and  0  for  the  hit  and  no  hit  channel  respectively.  The  interference  channel 
is  separated,  because  the  jth  channel  output  does  not  depend  on  the  symbols 
transmitted  from  other  users.  The  component  channel  model  is  shown  in  Figure 
4.3. 

When  error  detection  is  being  used  the  decoder  will  make  a  mistake  and 
accept  a  codeword  which  is  not  the  one  transmitted  if  and  only  if  the  error 
pattern  (vector)  is  a  nonzero  codeword.  If  Pnj  is  the  probability  of  a  particular 
j  bit  error  pattern  in  N  bits,  where  N  is  the  length  of  the  inner  code,  and  A,  is 


I 

I 


the  number  of  codewords  of  weight  j,  then  the  probability  of  undetected  error  is 
given  by  [Mac  77] 

N 


Pu  d  =  XI  AjPnj. 


(4.10) 


j=i 


For  the  above  channel  model,  is  given  by 


(  pM  •  2~n  +  (1  -  pM)  •  1,  i  =  0 
PN.j  ~  < 

(  pM  •  2~n  +  (1  -  phj)  -0,  j>  1. 
Thus  the  probability  of  undetected  error  is  given  by 

Pud  =  Ef=i  AjPnj 
=  PK,i2-NY.UAi 
=  -  2-*W 

since 

X>  =  2^-1, 

i=i 

for  any  linear  code  (A0=l). 

The  probability  of  a  detected  error  Pd  is  given  by 

Pd  —  1  ~  ■Pv.o  —  Pud 


(4.11) 


(4.12) 


(4.13) 


(4.14) 


since  1  —  PNp  is  the  probability  of  at  least  one  bit  error.  Figures  4.4  and  4.5  show 
the  variations  of  the  reliabilty  of  side  information,  i.e.,  variations  of  Pd  and  Pud, 
as  a  function  of  the  inner  code  length  N  for  several  values  of  K.  One  observation 
from  the  figures  is  that  the  probability  of  undetected  error  approaches  zero  and 
the  probability  of  detected  error  approaches  the  probability  of  a  hit  as  N  becomes 
large.  This  will  be  proved  later. 

The  maximum  allowable  inner  code  rate  for  the  reliability  of  side  information 
to  be  above  a  threshold,  i.e.,  Pud  <  Pud  and  Pd  >  Pd  for  some  Pud  and  Pd,  can 
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Figure  4.5:  Plot  of  detected  error  probability,  for  several  values 
of  K  ( synchronous  frequency-hopping,  q  =  100,  /  = 
50). 
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be  obtained  from  (4.11)  and  (4.13)  as  follows: 


Pud  =  2"" (2*  -  l)pM 

<  Pud 

=- K  £  '<>**  (t  ■ 2" +  0 

<  i  log,  ■  2"  +  l)  , 

Pd  =  (1-2-1"-*!  )p„, 

>  ^ 

5  W-lo*>(^) 

=>*  £  >-*■■«« to)- 


(4.16) 


Therefore, 


fi  <  min  (i  log,  (^  •  2"  +  l)  ,  l-*lof,(^;)) 

_  jv  ^°8j  •  2*  +  l)  *  Pi  +  Pui  <  Ph,/(1  -  2"N) 

1  ~  R  1o8j  *  P-  +  P«d  >  PM(1  -  2_Ar). 


(4.17) 


Figures  4.6  and  4.7  show  the  maximum  allowable  code  rate  to  satisfy  the  require¬ 
ment  for  Pud  <  and  Prf  >  P*  respectively. 

From  (4.11)  and  (4.13)  we  can  obtain  the  asymptotic  normalized  achievable 


rate  given  by 

rR  <  £(1  -  Pd  -  2Pud) 

=  ^(l  -  (l+2-(JV-*>  -2“N+l)Pfc./], 

and  the  asymptotic  normalized  throughput  given  by 

—  *  K. 1 

n  N  q 

=  5J[l-(l+2'^-|f)-2-'v+l)PM] 


(4.18) 


(4.19) 


If  the  number  of  redundancy  bits  iV  -  K  is  of  length  log2  N,  then  as  n  — ♦  oo 


(=>  JV  — ♦  oo,  because  n  =  M0  =  2N~[o,iN), 


R  = 


yv 


(4.20) 


~ ' "  1  ~  (P/».//2  +  1  —  Pv/) 

=  Pa./(1  —  2~N) 


This  implies  that  there  are  no  undetected  errors  and  every  hit  is  detected  as 
the  inner  code  length  becomes  large.  Therefore,  if  the  redundancy  bits  of  the 
inner  code  is  of  length  log2  N ,  then  for  large  values  of  N  one  can  expect  the  side 
information  provided  from  the  inner  code  to  be  increasingly  reliable,  and  yet  the 
fraction  of  the  transmitted  bits  devoted  to  the  redundancy  is  quite  small.  What 
this  means  is  that,  for  large  N,  the  super  channel  (combination  of  inner  encoder, 
channel,  and  inner  decoder)  behaves  as  if  perfect  side  information  were  available 
even  though  the  channel  provides  no  side  information. 

Therefore,  the  asymptotic  normalized  achievable  region  is  given  by 
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rR  <  ^\1-Pd-2PJ\ 

— •  1  -  Ph.i 

=  (I-,1)7'1 


(4.23) 


as  N,I,q  — »  oo  with  A  =  Ijq  held  constant,  and  the  asymptotic  normalized 


throughput  is  given  by 
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(4.24) 
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Figure  4.8:  m  bit  hit  patterns. 


as  N,  I,  q  — ♦  oo  with  A  =  I /q  held  constant.  Notice  that  the  asymptotic  normal¬ 
ized  achievable  region  and  the  normalized  throughput  derived  are  the  same  as 
those  that  can  be  obtained  with  perfect  side  information  (refer  to  (3.7)),  even 


though  the  channel  provides  no  side  information. 


4.3.2.  Asynchronous  Frequency-Hopping  System 


Now  we  relax  the  assumption  that  the  multi-user  interference  level  remains 


constant  throughout  the  hop.  We  consider  a  multi-user  communication  system 


where  the  signals  from  each  user  are  asynchronous  to  other  signals.  Then  the 


signal  of  interest  will  be  partially  overlapped  by  other  signals  as  indicated  in 


Figure  4.8. 
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If  the  signal  of  interest  is  hit  by  m  bits,  i.e.,  it  is  overlapped  by  other  signals  for 
the  m  bit  intervals,  (m  =  1, 2,  ■  •  ■ ,  Ar),  there  will  be  Hm  such  m  bit  hit  patterns, 
where 

( 

m-t-1,  m  =  1,2,  ■  •  • ,  N  -  1 
1,  m  =  N. 

The  probability  of  undetected  error  in  this  case  is  given  by 


Hm  = 


4.25) 


N 


Pud  =  XI  P^d.m  ■  P(m  bit  hit), 


(4.26) 


m=l 


where  Pud.m  denotes  the  probability  of  undetected  error  given  that  the  signal  is 
hit  by  m  bits,  and  P(m  bit  hit)  is  the  probability  that  the  signal  is  hit  by  m  bits. 
The  total  number  of  hit  patterns  can  be  obtained  from  (4.25)  as 


EH,,#..  =  i +  ££;!("> 


_  N(N  +  l) 
2 


(4.27) 


If  we  assume  that  every  hit  pattern  is  cqui-probable ,  then 
P{m  bit  hit)  = 


.  m  =  1, 2,  •  •  • ,  JV  —  1 

2 


Phi 

2 


(4.28) 


m  =  JV, 


where 


since  there  are  JV  bits  per  hop  ;Ger  82]. 

To  get  let  us  consider  an  m  bit  hit  pattern  as  shown  in  Figure  4.9. 

Notice  that  only  the  error  patterns  belonging  to  group  B  can  occur  from  the 
above  m  bit  hit  pattern.  Thus  the  probability  that  a  particular  j  bit  error 
pattern  in  group  B  occurs  given  the  above  m  bit  hit  pattern,  denoted  P,  m  g,  is 
given  by 

=  <}>’<>  -  i>- 

=  2-m. 

To  get  the  average  number  of  codewords  of  weight  j  in  group  B ,  denoted  A,  m  b< 
let  us  consider  the  following  random  coding  arguments:  we  choose  2*  codewords. 
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each  being  chosen  at  random  with  equal  probability  among  2s  sequences  and 
independently  of  the  other  codewords1,  and  then  choose  one  of  the  codewords 
with  equal  probability  among  2K  codewords  (call  it  c).  Then  the  probability  that 
c  has  weight  j  and  is  in  group  B  is  given  by 


P(weight(c)  =  j  ,  c  £  B) 


P(weight(c)  =  j  c  £  B)  ■  P(c  £  B ) 

2~m 


/  m  A 

rn 


2~s 
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V  J  J 


2  m 

'  2 * 


(4.30) 


Since  there  are  2K  codewords,  the  average  number  of  codewords  of  weight  j  in 
group  B,  Aym.B ,  is  thus  given  by 


(  \ 
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V  J  J 


(4.31) 


Notice  that  the  probability  of  a  j  bit  error  pattern  is  the  same  (i.e.,  2~m)  for  all 
m  bit  hit  patterns,  and  the  average  number  of  codewords  of  weight  j  that  can 
be  accepted  (by  a  mistake)  as  a  transmitted  codeword  is  the  same  for  given  m. 
Therefore,  the  probability  of  undetected  error  given  that  the  signal  is  hit  by  m 
bits  is  given  by 


Bud.m  =  X  A ym. B  P j.m.i 


\ 


m 


=  Er=i2_(N"K)  [  ’  j 2_m  (4-32) 

=  2-('v-k>(1  -  2"m), 

for  all  m  bit  hit  patterns.  Therefore,  the  probability  of  undetected  error  is  given 
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by 


Puj  =  ELi  Pud.m  •  P(m  bit  hit) 

_  r-V-U-[.V-K)h  0_mx  2(m-llpk  ,  o-j  N-K'/t  o-.Vl  2p»  / 

-  . — 'm=  1  “  l1  Z  )  ,V(.V^  1)  ~  ^  l1  Z  )n(,V-  1) 

=  2~l^,vI‘1';PV  '(-V  -  1 ) 2 ~ 'v ' 2  -  A’'2-‘V-1  -  2_n  -  0.5(  A’  -  l)(.v  -  2)  -  2  . 

(4.33) 

Notice  that  since  this  is  the  average  performance  of  all  possible  codes,  there  must 
exist  specific  codes  which  will  do  even  better. 

The  probability  of  detected  error  Pd  is  given  by 


s' 


Pd  -  1  -  P(no  error)  -  Pud , 


4.34] 
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since  1  -  P(no  error)  is  the  probability  of  at  least  one  error.  The  probability  of 
no  error  is  given  by 

P(no  error)  =  P(no  error  m  bit  hit)  •  P(m  bit  hit) 

_  It  \  r,V-U-m!lffltl|PU  ,  o-N  2Pk./ 

-  (1  -  PKJ)  ^  2-m=l  2  +  J  .V(N~1) 

=  1  -  PM  -  /vWfn'-V2'N  +  l  -  0V  ^  l)2'"*2  -  2_/V  *  3\ 


(4.35) 


Therefore  the  probability  of  detected  error  is  given  by 

Pd  =  Ph.i'y  ~  —  (-V  l)2”^v  +  l  2_,v  ■+■  3} 

.^-k.-J1{{N  4.  1)2-V+J  -  Ar2"N+1  -  2~*  -r0.5(AT  -  l)(Ar  -  2)  -  2} 

(4.36) 

Figures  4.10  and  4.11  show  the  variations  of  the  reliability  of  side  information, 
i.e.,  variations  of  Pud  and  Pd,  as  a  function  of  the  inner  code  length  Ar  for  several 
values  of  K . 

The  requirement  on  the  inner  code  rate  for  the  reliability  of  side  information 
to  be  above  a  certain  threshold,  i.e.,  Pud  <  Pud  and  Pd  >  Pd  for  some  Pud  and 
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Pd,  can  be  obtained  from  (4.33)  and  (4.36)  as  follows: 
Pud  <  Pud 

=► K  £  l0«.(fc 


N(N-i-1)2!' 


(N+l)2-N^2-N2-N-*-‘-2-N+0.i[N-l)(N-t2)-2 


) 


p  <-  n„  _  ivtAn-m*-* _ 

“  —  AT  1U®2  Vp/,.;  (N+1)2_,v  +  2-/s:2-n  +  1-2-w+0.5(N-1)(^  +  2)-2 


) 


(4.37) 


=  *ud, 


and 


^  ^ 


^  <T  l™  /  Ar(V+l)2*-‘(l-PJ/p,t,,)  +  2A/+3-3  2'v 

“  —  10&2  y{N  +  l)2-N  +  2-N2-N  +  i-2-N  +0.5{N-l)(N*2)-2 

P  <-  iU  (  MN+l)2*-1(l-/Wp)l,,)  +  2A/+3-3  2* 

K  -  N[°&2  \(N  +  l)2~ 


-*+1-N2-n+1-2~n  +O.S(N-l){N+2)~2 


(4.38) 


=  *<• 


Therefore, 


(4.39) 


R  <  min  (Rud,Rd) 

Rud,  Pud  +  Pd  <  pm(i  -  ifcffih-) 

Rdi  Pud  +  Pd  >  PA,/(f  ~  N{N  +  l)2N~l  )' 

Figures  4.12  and  4.13  show  the  maximum  allowable  code  rate  to  satisfy  the 
requirement  Pud  <  Pud  and  Pd  >  Pd  respectively.  By  comparing  Figures  4.4  -  4.7 
and  4.10  -  4.13  it  can  be  observed  that  the  reliability  of  the  side  information  for 
the  asynchronous  frequency-hopping  system  is  slightly  lower  than  that  for  the 
synchronous  frequency-hopping  system,  but  as  the  inner  block  length  increases 
the  difference  between  them  decreases  and  approaches  to  zero. 

If  the  number  of  redundancy  bits  of  the  inner  code,  N  —  K,  is  of  length  log2  N , 
then  the  code  rate  R  is  given  by 

„  _  N-\ot,N 

It  —  N 


(4.40) 


1, 


and  the  probability  of  undetected  error  is  given  by 

Pud  =  7^T){(N  +  1)2-n+2-N2-n+1-2-"+0.5(N-1)(N  +  2)-2\ 

-  0, 


(4.41) 
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Figure  4.13:  The  maximum  allowable  code  rate  to  satisfy  >  Pj 
( asynchronous  frequency-hopping,  q  =  100,  I  =  50). 
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and  the  probability  of  detected  error  is  given  by 

ft  =  Pw|l  -  utikviNr-""  -  (N  +  1)2-"*’  +  2-"  +  3} 

-jijJs j{(JV  +  l)2-"+!  -  m~N*'  -  2-"  +  0.5(JV  -  1  )(JV  +  2)  -  2}] 
Ph,I > 

(4.42) 

as  TV  — ♦  oo.  This  shows  that  as  in  synchronous  frequency-hopping  systems  perfect 
side  information  can  be  obtained  from  the  inner  code  without  any  loss  in  the  inner 
code  rate  as  N  — *  oo. 

Therefore,  the  asymptotic  normalized  achievable  region  and  the  normalized 
throughput  are  the  same  as  those  that  can  be  obtained  with  perfect  side  infor¬ 
mation,  That  is, 

rR  <  %{l-Pd-2Pud) 

-  (i  -  PhY~l  (4-43) 

and 

w  =  SJU-ft-zP.,) 

-  *(1  -Pa)1-1  M4) 

— ►  Ae_\ 

since 

P*  =  }[!  +  *(!-})] 

i 

as  Ar  — >  oo. 


4.4.  Diversity  /  RS  code 


The  simplest  type  of  block  code  allowing  a  variable  amount  of  redundancy 
is  the  repetition  code,  often  called  diversity.  With  this  code  a  single  informa¬ 
tion  symbol  is  encoded  into  a  block  of  L  identical  symbols,  producing  an  (L,  1) 
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code.  Each  symbol  is  transmitted  during  a  single  hop,  so  that  L  diversities  are 


transmitted  over  the  L  hops.  When  diversity  and  perfect  side  information  are 


employed,  the  inner  decoder  (diversity  decoder)  can  ignore  the  diversity  recep¬ 


tions  that  have  been  hit  and  it  can  extract  the  data  from  the  interference-free 


diversity  receptions.  If  all  the  diversity  receptions  of  a  symbol  are  hit,  they  are 


erased.  The  RS  outer  code  will  correct  the  erasures  if  the  number  of  erasures 


produced  by  the  inner  code  is  within  the  erasure  correction  capability.  When 


there  is  no  side  information,  the  inner  decoder  (a  maximum  likelihood  decoder) 


counts  the  number  of  times  each  symbol  was  received  and  chooses  the  one  that 


had  the  largest  count,  as  the  transmitted  symbol.  The  RS  outer  code  in  this  case 


will  correct  the  errors  produced  by  the  inner  decoder  if  the  number  of  them  is 


within  the  error  correction  capability. 


4.4.1.  Perfect  Side  Information 


If  the  perfect  side  information  is  available  at  the  receiver,  a  given  symbol  will 


be  erased  if  all  of  its  L  diversity  transmissions  are  hit:  otherwise,  the  symbol  is 


correctly  received.  In  this  case  the  probability  of  symbol  erasure  given  I  users, 


denoted  P/,£,  is  given  by 


Pi,L  =  [1  -  (1  -  P*)/_lf. 


(4.45) 


The  induced  super  channel  is  an  M- ary  erasure  channel  with  transition  proba¬ 


bility  Pi  l  and  M  =  A/,  =  M0.  See  Figure  4.14. 


Achievable  Region 


Since  the  input  symbol  to  the  (n,  k)  RS  outer  decoder  is  erasure  with  probabil¬ 
ity  Pj  i  and  the  erasures  at  different  hop  durations  are  conditionally  independent 


Figure  4.14:  M- ary  erasure  channel,  L  diversity,  perfect  side  infor¬ 
mation. 

given  /,  the  probability  of  correctly  decoding  a  codeword  (packet),  Pc(/),  is  given 


Pc(i)  =  E  n  pU  1-Pv.r*- 

>=°  j 


(4.46) 


As  n,  k  — *■  oo  while  r  =  k/n  is  held  constant,  it  can  be  shown  (see  Appendix  A) 
that  PC(I )  will  remain  1  as  long  as 


r  <  1  —  Pi,l 


(4.47) 


Thus  the  asymptotic  normalized  achievable  region  of  overall  code  rate  and  chan¬ 


nel  traffic  is  given  by 


rR  < 


l— (l— 

L  ’ 


(4.48) 


a \s  I,q  —*  oo  with  A  =  I/q  held  constant.  Figure  4.15  shows  the  asymptotic 


normalized  achievable  regions  for  various  diversity  levels.  We  can  see  that  the 
optimum  diversity  level  that  maximizes  the  asymptotic  normalized  achievable 


region  is  1  for  all  channel  traffic.  Figure  4.16  show  the  variations  of  the  normalized 
achievable  regions  as  q  increases.  We  can  see  that  the  asymptotic  formula  ( q  = 
oo)  gives  a  very  close  approximation  even  for  small  values  of  q. 


Solving  (4.47)  in  terms  of  /  we  can  obtain  the  maximum  number  of  simulta¬ 


neous  transmissions  given  by 


Mi-U-rji) 

ln(l-p») 


(4.49) 


As  q  approaches  infinity,  the  asymptotic  maximum  number  of  simultaneous  trans¬ 


missions  per  frequency  slot,  X  =  I/q,  becomes 


A  <  -ln(l-  (l-r)t)-1. 

n 


(4.50) 


For  the  case  of  finite  n,  an  approximate  achievable  region  of  channel  traffic 


and  outer  code  rate  for  PC[I )  >  1  -  Pe  is  given  by 

r  <  1  -  Pi,l  -  <x\JPi,l{1  ~  Pi.l)/™, 


(4.51) 


which  is  obtained  from  the  Gaussian  approximation  of  PC(I )  given  in  (4.46).  The 
normalized  achievable  region  can  be  obtained  by  dividing  by  L. 


Throughput 


From  (4.8)  and  (4.49)  the  asymptotic  normalized  throughput  is  given  by 


W  =  ''MO. 

Lq 


-  _r_  f-t  .  In(l-(l-r)t) 

~  Lq  [l  ^  ln(l-pk) 

T  In(  I  —  (1  —  r)  i)-1 


(4.52) 


as  q  — ♦  oo.  Figure  4.17  shows  the  asymptotic  normalized  throughputs  in  terms  of 
the  outer  code  rate  r  for  various  values  of  L.  We  can  see  that  the  overall  optimum 
diversity  level  that  maximizes  the  normalized  throughput  is  1,  but  the  optimum 


£ 


79 


deversity  level  is  changed  for  different  ranges  of  outer  code  rate.  Figure  4.17  will 


be  useful  when  decoding  complexity  should  be  considered  in  designing  a  system, 
because  the  decoding  complexity  of  a  code  of  rate  r  is  proportional  to  (1  —  r)2, 
and  in  some  high  performance  applications  the  extreme  decoding  complexity  may 


make  the  system  impractical  to  build.  For  example,  for  the  coding  system  used 


for  deep  space  communication  by  NASA  ((255,223)  RS  code),  we  can  see  that 


the  optimum  diversity  level  is  3. 


4.4.2.  No  Side  Information 


When  there  is  no  side  information  the  demodulator  makes  an  estimate  (hard 
decision)  on  the  received  signal,  and  the  inner  decoder  (a  maximum  likelihood 
decoder)  counts  the  number  of  times  each  symbol  was  received  and  chooses  the 


one  that  had  the  largest  count,  as  the  transmitted  symbol.  In  this  way  the 


inner  decoder  corrects  some  errors  and  passes  its  output  to  the  outer  decoder. 


However,  not  all  errors  can  be  corrected  by  the  inner  decoder,  so  there  is  a  nonzero 


probability  of  uncorrected  error.  The  probability  of  (uncorrected)  error  with 


diversity  L,  on  the  Af-ary  symmetric  channel  with  transition  probability 


pe  i/(M  —  1)  is  derived  in  [Sta  85]  by  assuming  that  the  conditional  probability 


of  symbol  error  given  hit  is  1  -  1/M.  If  we  let  p  =  pe  j  and  p  =  1  —  pe  /,  then  for 


large  enough  M,  PL  e  is  given  by 


Pi,*  =  P 


Pj.e  =  P 


Pz.t  =  1  -  Ps  ~  3 p2p  -  pp 2 


P*,e  =  1  -  P*  -  4p3p  -  6 p2p2  -  ppS 


(4.53) 


Pi  e  =  1  -  P5  -  5 p*p  ~  10pSp2  -  10p2pS  -  pp* 


P6,e  =  1  -  p6  -  6 psp  —  15p4p2  -  20psp5  -  15p2p4  -  pp5 


P j  e  =  1  -  p7  —  7 p6p  —  21p5p2  -  35p*pi  -  35 p3p*  -  21  p2p5  -  pp6 


Hi1  l*i 


l-p.. 
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Figure  4.18:  M- ary  symmetric  channel,  L  diversity,  no  side  informa¬ 
tion. 


The  induced  super  channel  is  an  M- ary  symmetric  channel  with  transition  prob¬ 


ability  Pl  J{M  -  1)  and  M  =  M,  =  A/,,.  See  Figure  4.18. 


Achievable  Region 


Since  the  input  symbol  to  the  RS  outer  decoder  is  in  error  with  probability 


Pl  e,  the  probability  of  correctly  decoding  a  codeword  (packet)  given  I  simulta¬ 


neous  transmissions  PC(I)  is  given  by 


l("-M/JJ  n 

Pc(I)=  £  PIM  -  Pl,)"-’ ■ 

;=°  \j 


(4.-4) 


As  n,k  — *  oo  while  r  =  k/n  is  held  constant,  it  can  be  shown  that  PC[I)  will 


remain  1  as  long  as 


r  <  1  -  2PL,t. 


(4.55) 
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The  asymptotic  normalized  achievable  region  is  obtained  by  dividing  the  above 
by  L,  and  is  plotted  for  various  values  of  L  in  Figure  4.19.  We  notice  that  the 
optimum  diversity  level  depends  on  the  channel  traffic,  which  is  not  the  case 
when  perfect  side  information  is  available. 

For  the  case  of  finite  n,  the  approximate  achievable  region  of  channel  traffic 
and  outer  code  rate  for  PC{I)  >  1  —  Pe  is  given  by 

2  - 

r  <  1 - \n PLtt  4-  aJ nPLe{\  -  PL,t)),  (4.56) 

n 

which  is  obtained  from  the  Gaussian  approximation  of  PC{I)  given  in  (4.54).  The 
normalized  achievable  region  can  be  obtained  by  dividing  by  L. 

Throughput 


From  (4.8)  and  (4.55)  the  asymptotic  normalized  thrpughput  is  given  by 

w  = 

Lq  J 

_  /(i-»Pl,.) 

~  Lq 

Figure  4.20  shows  the  asymptotic  normalized  throughp\its 
code  rate  r  for  various  values  of  L  .  As  in  perfect  mo*- 
can  see  that  the  overall  optimum  diversity  level  :\<t'  -..t 
throughput  is  1,  but  the  optimum  divers;t\  >  •< 
of  outer  code  rate. 
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CHAPTER  V 


PARALLEL  DECODING  FOR  IMPERFECT  SIDE 

INFORMATION 


5.1.  Introduction 


In  section  3.2  we  have  considered  the  achievable  regions  and  throughputs  of 
frequency-hopping  (FH)  multiple-access  systems  for  which  perfect  side  informa¬ 
tion  is  available  at  the  receiver.  In  practice,  however,  the  assumption  regarding 
the  perfect  side  information  is  only  approximately  true.  In  this  chapter  this  as¬ 
sumption  is  relaxed,  and  we  consider  the  performance  of  the  FH  multiple-access 
systems  which  has  imperfect  side  information  at  the  receiver. 

The  purpose  of  the  side  information  is  to  determine  which  received  symbols 
are  to  be  erased.  The  side  information  regarding  the  presence  of  hit  is  extracted 
from  the  dehopper  and  demodulator.  However,  there  is  a  chance  that  some 
symbols  with  interference  will  be  missed  (miss)  and  other  symbols  which  have 
no  interference  will  be  erased  (false  alarm).  We  define  Pr  as  the  probability  that 
the  demodulator  produces  the  erasure  symbol  given  the  symbol  was  “not  hit” 
and  Pm  as  the  probability  that  the  demodulator  does  not  produce  the  erasure 
symbol  given  the  symbol  was  "hit”.  Then  Pm  and  Pr  give  us  a  measure  of  the 
“imperfectness”  of  the  side  information:  for  example,  Pm  —  Pr  =  0  corresponds 


to  the  perfect  side  information  case,  and  Pm  =  1  ,Pp  =  0  corresponds  to  the 
no  side  information  case,  because  the  demodulator  never  produces  the  erasure 
symbol  when  there  is  no  side  information.  Thus,  perfect  side  information  and  no 
side  information  are  a  special  case  of  the  imperfect  side  information. 

In  this  chapter  we  assume  that  only  imperfect  side  information  is  available  at 
the  demodulator.  The  demodulator  decides  first  whether  to  erase  the  received 
signal  or  not  based  on  the  side  information  given  to  it.  If  the  received  signal  is 
not  erased,  it  is  further  processed  to  get  the  estimate  of  the  transmitted  signal. 
We  will  consider  two  different  models  for  the  demodulator. 

The  demodulator  output  is,  in  general,  a  sequence  of  errors,  erasures,  and 
correct  symbols.  In  order  to  correct  the  errors  and  erasures  we  employ  a  Reed* 
Solomon  code,  and  consider  two  different  decoders  for  it:  one  is  the  errors-and- 
erasures  decoder  and  the  other  is  a  parallel  decoder. 

The  remainder  of  this  chapter  is  organized  as  follows.  In  section  5.2  we  intro¬ 
duce  two  demodulator  models  and  derive  the  probabilities  of  error  and  erasure  in 
terms  of  channel  traffic  for  both  demodulator  models.  In  section  5.3  we  compute 
the  capacity  of  the  component  channel  resulting  from  one  demodulator  model, 
and  discuss  an  idea  for  improving  the  capacity.  In  section  5.4  we  consider  an 
errors-and-erasures  decoder,  and  evaluate  the  performance  of  it  over  the  imper¬ 
fect  side  information  channel.  Based  on  the  ideas  given  in  section  5.3  and  5.4  we 
suggest  a  parallel  decoding  scheme  and  evaluate  the  performance  of  it  over  the 
imperfect  side  information  channel.  These  are  discussed  in  section  5.5. 

5.2.  Demodulator  Models 

In  the  first  model  (we  call  it  “demodulator  model  1:  worst  case”),  if  a  received 
signal  is  hit,  and  not  erased,  it  is  demodulated  to  one  of  the  Af  equally  likely 


Figure  5.1:  Demodulating  procedures,  demodulator  model  1. 

symbols  so  that  the  probability  of  symbol  error  is  1  -  l/M,  independent  of  the 
number  of  hits  and  which  symbols  transmitted  from  the  interferes.  If  it  is 
not  hit  and  not  erased,  it  is  demodulated  correctly.  The  resulting  interference 
channel  is  classified  as  a  “separated”  channel  by  its  definition  given  in  (2.1). 
Demodulating  procedures  for  demodulator  model  1  are  summarized  in  Figure  5.1, 
and  the  component  channel  model  is  shown  in  Figure  5.3.  Thus  the  probability 
of  erasure  is  given  by 

Ptr.i  —  P  (erasure  |  I  uses) 

=  P  (erasure  |  hit,  /)  P(hit  |  I)  +  P  (erasure  |  no  hit,  I)  P(no  hit  |  I) 

—  (l  ~  Pm)ph,i  +  Pr{l  ~  Pa./)* 


and  the  probability  of  error  is  given  by 

pt,i  =  P  (error  1 7  users) 

=  P (error,  no  erasure  |  7)  +  P (error,  erasure  |  7) 

“■  s/""  ■■ 

=0 

=  P (error,  no  erasure  |  hit,  7)  P(hit  |  /) 

+P(error,  no  erasure  |  no  hit,  7)  P(no  hit  1 7) 

=  P (error  |  no  erasure,  hit,  7)  P(no  erasure  |  hit,  7)  P(hit  1 7) 

. . —  V . 

=1-1 /M 

+  P  (error  j  no  erasure,  no  hit,  7)  P(no  erasure  |  no  hit,  7)  P(n o  hit  1 7) 
=o 

=  (1  -  \fM)Pu  Pk,I- 

(5.2) 

In  the  second  model  (we  call  it  “demodulator  model  2:  realistic  case”)  both 
the  number  of  hits  and  which  symbols  being  transmitted  from  the  interferers  are 
taken  into  account  in  calculating  the  probability  of  error.  If  a  received  signal  is 
hit  by  m  interferers,  i.e.  m  hits,  and  is  not  erased,  the  probability  of  symbol  error, 
Pmi  is  given  by  (3.49).  If  it  is  not  hit  and  not  erased,  it  is  demodulated  correctly. 
In  this  case,  the  resulting  interference  channel  is  not  separated,  because  the 
property  given  in  (2.1)  is  not  satisfied.  Demodulating  procedures  for  demodulator 
model  2  are  summarized  in  Figure  5.2.  Thus  p„j  is  the  same  as  given  in  (5.1), 
but  Ptj  for  large  M  is  given  by 

p,j  =  P (error  |  7  users) 

=  P (error,  no  erasure  |  7)  +  P  (error,  erasure  |  7) 

>  v  ”  1  ^ 

*0 

=  P(error,  no  erasure  |  m  hits,  7)  P(m  hits  |  7) 

=  EZzJq  P(error  |  no  erasure,  m  hits,  7) 

P(no  erasure  |  m  hits,  7)  P(m  hits  |  7) 


(5.3) 
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Figure  5.2:  Demodulating  procedures,  demodulator  model  2. 
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In  both  models,  the  demodulator  output  is  a  sequence  of  errors,  erasures,  and 
correct  symbols.  Thus  the  component  channel  with  imperfect  side  information 
is  modeled  by  an  Af-ary  errors-and-erasures  channel  with  certain  erasure  proba¬ 
bility  ptrj  and  certain  error  probability  pf>/,  which  depend  on  Pm,  Pp,  and  the 
number  of  simultaneous  packet  transmissions  in  a  time  slot.  This  component 
channel  model  is  shown  in  Figure  5.3. 

5.3.  Component  Channel  Capacity 

The  channel  capacity  of  an  Af-ary  errors-and-erasures  channel  in  information 


Figure  5.3:  Imperfect  side  information  channel  model. 


symbols  per  channel  use  is  given  by 

c,/)  -  - - - -  log„ 

(5.5) 

Notice  that  for  Pm  =  Pp  =  0  (perfect  side  information), 


C(I)  =  1  -  p*r,/ 

=  (1  -PhV~\ 


(5.6) 


and  for  Pm  =  l,Pp  —  0  (no  side  information), 

c(l)  =  (1  -  p.j )  log„(M(l  -  p.j))  +  p.j  logM(^i).  (5.7) 

As  mentioned  in  Section  5.2,  since  the  channel  resulting  from  demodulator  model 
is  not  separated,  only  the  channel  resulting  from  demodulator  model  1  will  be 
considered  in  this  section.  For  model  1,  by  applying  (5.1)  and  (5.2)  into  (5.4)  we 
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CM 


(PmPhj/M  +  (1  —  Pp)'  1  -  Pk,i))  l°gw 


V  PMPk,l  +  (l-Pp)[l-Pk,l)  ) 


+  (PMb*MLPhj)  logW  ( 


PmPK.I 


— Pfc,/ ) )  ■ 


(5.8) 

Figure  5.4  shows  the  component  channel  capacity  in  terms  of  the  channel  traffic, 
X  =  I/q,  for  several  values  of  Pm  and  PF.  We  notice  that  there  is  a  threshold  in 
channel  traffic,  A tll,  such  that  for  A  <  Xtk  the  channel  capacity  can  be  increased  by 
ignoring  the  imperfect  side  information  (thus  do  not  erase)  and  making  a  hard 
decision  demodulation  of  the  received  signals.  This  implies  that  for  the  lower 
traffic  it  is  advantageous  to  make  a  hard  decision  demodulation  rather  than  to 
try  to  make  an  (erroneous)  erasure  based  on  the  imperfect  side  information.  We 
also  notice  that  the  threshold  At/,  increases  as  Pm  and  PF  increase,  that  is,  as 
the  side  information  becomes  less  reliable.  On  the  other  hand,  as  the  alphabet 
set  size  becomes  large,  it  can  be  shown  from  (5.4)  that  the  component  channel 
capacity  approaches 


lim*/_00  C(I)  =  1  -  p„j  -  pej 

=  (l-JVHl-pfc)7"1  (5.9) 

-  (l-PF)e-”\ 

as  I,q  — »  oo  while  A  =  I/q  is  held  constant.  This  implies  that  for  large  enough 
M ,  the  component  channel  capacity  can  be  increased  by  ignoring  the  imperfect 
side  information  (thus  PF  =  0)  and  making  a  hard  decision  demodulation  of 
the  received  signals  for  all  channel  traffics.  Notice  that  the  resulting  component 
channel  capacity  e~nX  is  the  same  as  that  obtainable  from  perfect  side  informa¬ 
tion.  It  can  be  also  noticed  from  (5.8)  that  the  limiting  (Af  — ►  oo)  value  of  the 
component  channel  capacity  depends  only  on  PF  (independent  of  Pm)-  This  can 
be  explained  as  follows.  If  a  received  signal  is  hit  it  results  in  either  error  with 
probability  Pm  (because  1  —  1/M  — ►  1)  or  erasure  with  probability  1  —  Pm  (see 


Figure  5.5:  Receiver  model. 


Figure  5.1).  However,  the  events  of  error  and  erasure  give  the  same  effect  on 
the  component  channel  capacity  in  the  sense  of  information  loss.  Therefore,  the 
component  channel  capacity  is  independent  of  Pm-  On  the  other  hand,  when  the 
signal  is  not  hit,  it  results  in  erasure  (i.e.,  information  loss)  with  probability  PF. 
Therefore,  the  component  channel  capacity  is  a  function  of  PF. 

5.4.  Errors-and-Erasures  Decoding  Scheme 


The  block  diagram  of  the  receiver  to  be  considered  is  shown  in  Figure  5.5.  The 
incomplete  demodulator  output  has  an  alphabet  set  of  {0, 1,  ...,M  —  1,?},  and  is 
a  sequence  of  errors,  erasures,  and  correct  symbols.  As  before,  let  p„j  and  p,j 
denote  the  probability  of  symbol  erasure  and  error  given  I  users  respectively.  The 
RS  decoder  corrects  the  errors  and  erasures  if  the  sum  of  the  n limber  of  erasures 
and  twice  the  number  of  errors  is  less  than  or  equal  to  n  —  k.  Therefore,  the 
probability  of  correctly  decoding  a  codeword  given  7  simultaneous  transmissions, 
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Pc(/),  is  given  by 


p,(i)  =  E 

1+Jm<n- 4 


/ 

n 

l,m 


pLjPTA1  ~  P'rJ  ~  P'A 


n—l—m 


(5.10) 


Asymptotically  as  n  and  k  approach  infinity  while  the  code  rate  r  =  k/n  is  held 
constant,  it  can  be  shown  (see  Appendix  C)  that 


Hm  Pe(J )  = 

n,k—oo  V  ' 


1,  r  <  1  -  per  /  -  2 peJ 

<  0.5,  r  =  1  -  per  /  -  2 pt<1 

0,  r  >  1  -  ptrJ  -  2 peJ. 

That  is,  “error-free”  communication  is  possible  asymptotically  provided 

r  <  1  -  Per, I  -  2 PeJ. 


(5.11) 


(5.12) 


5.4.1.  Demodulator  Model  1:  Worst  Case 

From  (5.1),  (5.2),  and  (5.11)  the  asymptotic  achievable  region  of  code  rate 
and  channel  traffic  for  arbitrarily  small  error  probability  is  given  by 

r  <  (1  +  PM  -  PF)(1  -  Ph)1-1  -  PM 
—*  (1  +  Pm  —  Pf)e_,?A  —  Pm, 

or  equivalently, 

'  1  +  P m  —  Pf  ' 


(5.13) 


A  < 


—  In 

V  \  r 


V  \  r  +  PM 
as  /,  q  — »  oo  while  A  =  I/q  is  held  constant. 

The  asymptotic  normalized  throughput  can  be  obtained  from  (5.12)  as 


W  = 


Pc(I) 

J(1  -  Per, I  ~  2 Pe,l) 


=  i[(i  +  Pm  -  Pf)(i  -  Phy-' -  pM\ 

—*  A[(l  +  P m  —  Pf)c~,,x  —  Pm], 
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Figures  5.6  and  5.7  show  the  achievable  regions  and  the  normalized  throughputs 
for  various  values  of  PM  and  Pp.  We  notice  that  as  in  the  channel  capacity 
case,  the  achievable  region  and  the  throughput  can  be  increased  by  making  a 
hard  decision  demodulation  and  error-correction  decoding  for  the  lower  channel 
traffic. 

Also,  it  can  be  shown  from  (5.14)  that 

SW 

m  ~  (516) 

and 


dW 

dPM 


— A(1 


(5.17) 


so  that 


and 


aw  ^  dW 
dPF  > 

aw 


a  Pm 
aw 


for  A  >  —  In  2, 
V 


for  A  <  —  In  2. 
V 


(5.18) 


(5.19) 


dPF  3Pm 

These  imply  that  for  A  >  A  In  2  the  throughput  decreases  faster  along  the  Pm 
axis  than  along  the  Pf  axis,  and  for  A  <  A  In  2  the  opposite  happens.  The  ways 
in  which  the  throughput  decreases  as  a  function  of  Pm  and  Pp  is  shown  in  Figure 
5.8. 


Optimum  code  rate,  optimum  traffic,  and  maximum  normalized  throughput 


To  get  the  optimum  channel  traffic  at  which  the  normalized  throughput  W  is 
maximized,  we  take  the  derivative  of  W  w.r.t.  A,  and  set  it  to  zero.  This  results 
in  the  following  nonlinear  equation: 


t-"x(l  -  r,A)  = 


Pm 

1  +  Pm  —  Pf 


(5.20) 


This  equation  will  have  a  unique  solution,  because  RHS  is  a  constant  between  0 
and  1,  and  LHS  is  a  strictly  decreasing  (at  least  from  1  to  0)  function  of  A  as 


•  H  A 

o-n*) 


Figure  5.9:  Plot  of  e-nA(l  —  »/A)  vs.  A. 


shown  in  Figure  5.9.  Also,  by  taking  second  derivative  of  W  w.r.t.  A,  we  get 

d2W  „  _ w  . 


=  17(1  +  PM  -  PF)e-^{VX  -  2). 


From  Figure  5.9  we  can  see  that  the  solution  of  (5.19),  call  it  A^,  has  the 
property  A^,  <  l/rj.  Thus 

d'W  _  .  . 


<0  at  A  =  A a_t. 


Therefore  there  should  exist  a  unique  optimum  channel  traffic  where  the  nor¬ 


malized  throughput  is  maximized.  Thus  the  optimum  channel  traffic  A^  can  be 
found  from  (5.19),  and  at  A^  the  optimum  code  rate  is  obtained  from  (5.12) 
and  (5.19)  as 

r»pt  =  (1  +  PM  -  Pf)*-'*-"  -  Pm 


—  1  Ini 

~  » 


(5.21) 


and  at  A ^  and  the  maximum  normalized  throughput  is  given  by 

wwr 


1  —  T)X  opt 


(5.22) 
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In  Table  5.1  we  list  W^,,  r ^  and  A^,  for  various  values  of  PM  and  PF . 

For  the  case  of  finite  block  length  codes,  Pe(I)  can  be  approximated  as  (see 


Appendix  C) 


where 


»,(/)  «  F  f- 


- k-m ' 


m  =  n(p„j  +  2  ptj) 


(5.23) 


(5.24) 


o 2  =  n(p„tJ  -  p^j  +  ^Ptj  -  Ap\j  -  Aptrjptj). 

Therefore  the  achievable  region  for  Pe(I)  >  1  -  Pe  »s  approximately  given  by 
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r  <  (1  -  per>/  -  2p<tj)  -  ocJ(Perj  ~  Pl.i  +  4pti/  -  4p3t  I  -  4p«rt/p«./)/n.  (5.25) 
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5.4.2.  Demodulator  Model  2:  Realistic  Case 


By  applying  (5.1)  and  (5.3)  into  (5.11),  the  asymptotic  achievable  region  of 
code  rate  and  channel  traffic  can  be  obtained  as 


(5.27) 


r  <  1-  p„j  -  2p.j 

=  (i  -pu-  j»(  i  -  «)'-*  +  Pu  - 1)  (5-26> 

-  (1  -  Pu  -  JV)e-»»  +  Pu  (J(^)  -  l)  , 

as  I,q  — »  oo  while  A  =  I/q  is  held  constant.  Thus  the  asymptotic  normalized 
throughput  is  obtained  from  (5.25)  as 

w  =  ;//>.(/; 

->  ;(1  -  P~J  -  2P../)  (5.27) 

=  ;  [(1  -  Pm  -  f»(l  -  -  l)] 

-  A[(l-P„-P,)e--»  +  f«(j(»=ipi)-l)]. 

Figures  5.10  and  5.11  show  the  achievable  regions  and  the  normalized  through¬ 
puts  for  various  values  of  Pst  and  PF.  We  can  see  again  that  the  performance 
can  be  improved  by  making  a  hard  decision  demodulation  and  error-correction 
decoding  for  the  lower  traffic.  In  Figures  5.12  and  5.13  we  compare  the  perfor¬ 
mances  obtained  from  the  two  demodulator  models. 

From  (5.26)  it  can  be  shown  that 


£51  = 

apF  ’ 


(5.28) 


so  that 


dw 
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dPM  ~ 
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dPF  ~ 

dPst 

aw 
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(5.29) 
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(5.31) 
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Figure  5.10:  Achievable  regions  of  code  rate  and  channel  traffic, 
errors- and-erasures  decoding,  demodulator  model  2 
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Figure  5.12:  Comparison  of  the  achievable  regions  obtained  from  the 
two  demodulator  models,  errors- and-erasures  decoding. 
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Figure  5.13:  Comparison  of  the  normalized  throughputs  obtained 
from  the  two  demodulator  models,  errors-and-erasures 
decoding. 
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Figure  5.14:  Plot  of  the  normalized  throughput  vs.  [Pm,  Pf),  errors- 
and-erasures  decoding,  demodulator  model  2. 

These  imply  that  for  A  >  1.594 /q  the  throughput  decreases  faster  along  the  Pm 
axis  than  along  the  Pp  axis,  and  for  A  <  1.594/q  the  opposite  happens.  The 
ways  in  which  the  throughput  decreases  as  a  function  of  Pm  and  Pf  is  shown  in 
Figure  5.14. 

Optimum  code  rate,  optimum  traffic,  and  maximum  normalized  throughput 


To  get  the  optimum  channel  traffic  at  which  the  normalized  throughput  W  is 
maximized,  we  take  the  derivative  of  W  w.r.t.  A,  and  set  it  to  zero.  This  results 


in  the  following  nonlinear  equation: 


(1  +  Pm  -  Pf)  ~  *?(1  -  Pm  ~  P r)^  =  Pm^x- 


(5.32) 


From  Figure  5.15  we  can  see  that  there  exist  a  unique  solution  because  LHS  and 
RHS  meet  at  exactly  one  point.  Also,  by  taking  second  derivative  of  W  w.r.t.  A, 
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Figure  5.15:  Plot  of  Pm^X  and  (1  +  PM  —  PF)  -  rj(  1  —  PM  —  PF) A  vs. 
A. 


we  get 


=  -r?e-"A[2(l  -  PF)  -  n{l  -Pm~  Pf)A]. 


For  1  —  Pm  —  Pf  <  0  case,  it  is  obvious  <  0.  For  1  —  Pm  —  PF  >  0  case, 


the  solution  of  (5.31),  call  it  Aop(,  has  the  property  \opt  <  (1  +  Pm  —  PfVM  1  — 
Pm  -  Pf)]-  Thus 

d2W 

~q^2~  -  ®  at  A  —  A  opt. 

Therefore  the  unique  optimum  channel  traffic  Aopt  can  be  found  from  (5.31),  and 

at  Xopt  the  optimum  code  rate  is  obtained  from  (5.25)  as 

(21  _  \ 

-(  - )  -  lj  ,  (5-33) 

and  at  A^i  and  ropt,  the  maximum  normalized  throughput  is  obtained  from  (5.26) 
and  (5.31)  as 


(V.U..  =  i|(l  -Pm-  p, l*-"1-  +  Pu(  1  -  2A„,)]. 
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0.096 

0.098 

0.100 

0.101 

0.102 

0.103 


0.037 

0.044 

0.047 

0.049 

0.050 

0.051 

0.052 

0.053 

0.054 

0.054 

0.0S4 


0.184 

0.179 

0.175 

0.171 

0.168 

0.165 

0.162 

0.159 

0.157 

0.155 

0.153 


0.166 

0.160 

0.157 

0.153 

0.150 

0.147 

0.144 

0.142 

0.140 

0.138 

0.136 


0.147 

0.142 

0.138 

0.135 

0.132 

0.129 

0.126 

0.125 

0.122 

0.120 

0.118 


0.129 

0.124 

0.120 

0.117 

0.114 

0.112 

0.109 

0.107 

0.105 

0.104 

0.102 


0.110 

0.106 

0.102 

0.099 

0.096 

0.094 

0.092 

0.090 

0.088 

0.087 

0.085 


0.092 

0.087 

0.084 

0.081 

0.079 

0.076 

0.075 

0.073 

0.071 

0.070 

0.069 


0.074 

0.069 

0.066 

0.063 

0.061 

0.059 

0.058 

0.056 

0.055 

0.053 

0.053 


0.055 

0.051 

0.048 

0.046 

0.044 

0.042 

0.041 

0.040 

0.039 

0.038 

0.037 


0.037 

0.033 

0.031 

0.029 

0.027 

0.026 

0.025 

0.025 

0.024 

0.023 

0.022 


Table  5.2:  Aop<,  ropt,  and  W^g,  errors-and-erasures  decoding,  de¬ 
modulator  model  2,  r\= 2. 


0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 


0.018 

0.015 

0.014 

0.013 

0.012 

0.011 

0.011 

0.010 

0.010 

0.010 

0.009 


0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 
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Figure  5.16:  Parallel  decoding  system. 

In  Table  5.2  we  list  Wm az,  r^,  and  Aopt  for  various  values  of  Pm  and  PF. 

For  finite  block  length  codes,  the  achievable  regions  for  PC[I)  >  1  —  Pe  is 
approximately  given  by  (5.24)  with  pej  and  per>/  given  in  (5.3)  and  (5.1)  respec¬ 
tively. 

5.5.  Parallel  Decoding  Scheme 

We  have  observed  in  sections  5.3  and  5.4  that  there  is  a  threshold  in  channel 
traffic  such  that  for  the  lower  traffic  it  is  advantageous  to  ignore  the  imperfect 
(unreliable)  side  information  and  make  a  hard  decision  demodulation  of  the  re¬ 
ceived  signals,  and  for  the  higher  traffic  to  try  to  erase  the  unreliable  symbols. 
This  suggests  the  following  parallel  decoding  scheme  whose  block  diagram  is 
shown  in  Figure  5.16.  The  output  of  the  demodulator  is  a  pair  (x,y):  the  first 
component  is  the  input  to  the  errors-and-erasures  decoder  and  the  second  com¬ 
ponent  is  the  input  to  the  errors-only  decoder.  The  output  of  the  incomplete 
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demodulator,  x,  is  either  a  symbol  estimate  or  an  erasure,  and  it  is  in  the  al¬ 
phabet  set  of  {0,1,  ...,Af  —  1,?}.  On  the  other  hand,  the  complete  demodulator 
makes  a  hard  decision  demodulation  of  the  symbol  transmitted,  and  its  output, 
y,  is  in  the  alphabet  set  of  {0, 1, ...,  M  —  l}.  If  x  is  not  an  erasure,  then  x  and  y 
are  identical.  We  will  assume  throughout  that  RS  decoder  never  errors  (produces 
the  wrong  codeword)  but  always  fails  (gives  up)  when  the  number  of  errors  and 
erasures  exceeds  the  capability  of  the  code.  In  fact,  if  a  Reed-Solomon  code  is 
being  used  and  the  decoder  is  attempting  to  correct  t  errors,  the  probability  of 
a  decoding  failure  is  approximately  t\  times  the  probability  of  a  decoding  error 
[Ber  80]:  as  n  — *•  oo,  t  =  n(^yr)  — ♦  oo  =►  tl  — ♦  oo  =»  P (decoding  error)  — *•  0. 

Therefore  a  codeword  (packet)  error  occurs  if  both  decoders  fail  and  at  least  one 
symbol  out  of  the  complete  demodulator  is  in  error. 

Previous  studies  on  parallel  decoder  begin  with  [Pur  82],  in  which  the  use  of  a 
parallel  combination  of  erasures-decoding  and  errors-decoding  for  Reed-Solomon 
codes  was  introduced.  Soon  after,  it  is  applied  in  [Pur  83]  and  [McC  83]  to 
increase  the  jamming  margin  against  a  partial-band  jammer.  In  all  of  those 
works,  the  perfect  side  information  was  assumed  to  be  available  at  the  receiver. 

For  the  partial-band  jamming ,  no  side  information  environment,  Castor  [Cas  86] 
analyzed  a  parallel  combination  of  diversity  decoder/errors-and-erasures  decoder 
and  diversity  decoder/errors-only  decoder.  In  this  section  we  will  evaluate  the 
performance  of  the  suggested  parallel  decoding  scheme  under  the  multiple-access , 
imperfect  side  information  environment. 

I 

I 

! 

5.5.1.  Achievable  Region  and  Throughput  i 

~  i 

Let  us  first  define  the  following  random  variables:  j 

Z\  =  the  number  of  symbols  in  the  received  packet  for  which 


Mltf  V  I'JI  MMM  Wl*!WWtfU  W  A  I-  IP.1  HI*1  rTWWWWWA.'^'*.  JV  .'IHH  -'M^n  ■ i  >  .?w.^vwA’yvrv  ■.-VP.nwmm*.**? 
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x  is  erasure  and  y  is  in  error. 


Z2  =  the  number  of  symbols  in  the  received  packet  for  which 
x  is  not  erasure  and  y  is  in  error, 

Z3  =  the  number  of  symbols  in  the  received  packet  for  which 
x  is  erasure  and  y  is  not  in  error. 


Then  there  are  Z\  +  Zs  erasures  and  Z2  errors  at  the  input  of  the  errors-and- 
erasures  decoder,  and  Z\  +  Z2  errors  at  the  input  of  the  errors-only  decoder. 
Therefore  the  packet  (codeword)  error  probability  given  I  simultaneous  trans¬ 
missions,  Pe(J),  is  given  by 

Pe{I)  =  jP(Zj  +  Z3  +  2Z2  >  n  —  k  pi  Zt  +  Z2  >  fl  Z2  +  Z2  >  0) 

=  P(Zi  +  Zs  +  2Z2  >  n  —  k  Pi  Zi  +  Z2> 


(5.35) 


This  implies  that  the  performance  (in  terms  of  packet  error  probability)  is  the 
same  whether  the  complete  demodulator  output  is  selected  or  not.  Therefore 
we  will  consider  the  modified  parallel  decoding  scheme  which  has  no  path  from 
the  complete  demodulator  to  the  selector,  i.e.,  without  the  dotted  line  in  Figure 
5.16. 

Since  the  events  of  Z\,  Z2,  and  Zs  are  mutually  exclusive  and  they  are  in¬ 
dependent  from  symbol  to  symbol  within  a  codeword,  the  joint  distribution  of 
Zx,  Z2,  and  Z3  may  be  calculated  as  [Kal  85] 


( 


P{Z\  =  j,  Zs  =  l,  Z3  =  m)  = 


n 

j,l,m 


Pi  P2  pH1  -  Pi Ps)"  1  ‘~m, 

(5.36) 


where 


Pi  =  P(  a  received  symbol  is  erased  and  in  error  )  I  users  ) 


Ps  =  P(  a  received  symbol  is  not  erased  and  in  error  |  I  users  )  (5.37) 


Ps  =  P(  a  received  symbol  is  erased  and  not  in  error  |  /  users  ). 


"j 


% 


8 


& 

rj 


8 


§ 


112 


Thus  the  codeword  error  probability  given  I  users,  Pe(I ),  is  given  by 
Pe{I)  =  t,  E  £  P (Z,  =  y.  Z,  =  /,  Z,  =  m), 

j=Ql=h(j) 

where 


(5.38) 


Mi)  =  max{0,[aj±J  -j  +  1}, 

g[j,l)  =  max  {0,n  -  fc  -  i  -  2/  +  1}. 

To  get  the  limiting  value  of  Pe(I)  as  n,)fe  — ►  oo,  let  us  define  the  following 
random  variables: 


X„  =  Z\  +  2Zj  +  Zi 

y.  =  2, +  2, 


v.  = 

kb  £  Mm. 


(5.39) 


Then,  Xn  is  the  sum  of  the  number  of  erasures  and  twice  the  number  of  errors 
at  the  input  of  the  errors- and-erasures  decoder,  and  Yn  is  the  sum  of  the  number 
of  errors  at  the  input  of  the  errors-only  decoder.  Therefore, 

PE(I)  =  P(Xn>n-k,  Yn>  L^J) 

=  P(U~  >  ^  >  ^j^)  (5.40) 


_  BfTT  --  n-k-E{Xn)  t/  ^  LaT4J-^(y») ' 

~  nUn  >  y/Vor(Xn)  ’  ^ 

=  P(t/„  >  a>/n,  V„  >  6^/n), 


where 


$ 

£(X.) 

£(V») 

"* 

Vor(Jf„) 

£ 

Vo  r(y„) 

a 

l-r-pi -Zpi-pa 

nPi-P?+<Oa-4pf+P»-pf-4PiPa-*PiP»-<Par*) 
^(Pi+Pa)(l-Fi-Ps)  ’ 


(5-41) 


By  the  central  limit  theorem,  as  the  code  length  n  becomes  large,  it  is  well  known 
that  the  distributions  of  Un  and  Vn  approach  the  standard  normal  distribution 
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with  mean  zero  and  variance  one.  That  is,  as  n  — ►  oo, 

-F<?(u)  —  Ci  <  Fum(u)  <  Fg(u)  + 

and 

Fg(v)  —  cj  <  Fvh(v)  <  Fg{v)  +  Cj, 
for  arbitrarily  small  positive  £j  and  £2,  where 


fi-.W  =  P(U,<U) 

Fy.  («)  =  P(V„  <  v) 

FcM  =  /*„  Jr.'-'11**- 


(5.42) 


(5.43) 


(5.44) 


Thus,  as  n,k  — *•  oo  while  r  =  fc/n  is  held  constant 

p*(/)  =  P(^n  >  a^»,  Vn  >  6v/n) 

<  P{Un  >  a^/n) 

=  1  -  (a-y/n)  (5.45) 

<  1  —  F(j(ay/n)  +  Cj 
-  0, 

if  a  >  0.  Similarly, 

PE(I)  <  P(Vn>by/Z) 

—  1  —  Fvn  {b^yn) 

"V  V  '  (5.46) 

<  1  —  Fo(by/n)  +  £2 

-  0, 

if  b  >  0.  Therefore,  the  codeword  (packet)  error  probability  Pe{I)  approaches 
zero  asymptotically  if 

a  >  0  or  b  >  0,  (5*47) 

4=>  r  <  1  -  pi  -  2pt  -  Pi  or  r  <  1  -  2pi  -  2pi  (5.48) 

<=>  r  <  max  {1  -  pi  -  2p*  -  ps,  1  -  2 px  -  2pi).  (5.49) 


(5.45) 

it 
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S 

£ 

(5.46) 
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Also,  it  can  be  shown  that  a s  n  -*  oo, 


Pe(I)  -  1, 


if  a  <  0  and  6  <  0,  i.e.,  r  >  max  {l  —  px  -  2 p2  -  p3,  1  -  2pi  -  2p2} 

Pe(I)  =  P{Un  >  a y/n  ft  V„  >  by/n) 

=  1  —  P(Un  <  ay/n  U  Vn  <  by/*) 

>  1  -  P(Un  <  ayfr)  -  P{Vn  <  by/n) 


*0,  if  a<0 


—0,  if  K0 


1, 


as  n  — »  oo.  Therefore,  (5.48)  represents  the  asymptotic  achievable  regions  of  code 
rate  and  channel  traffic  for  arbitrarily  small  error  probability.  The  asymptotic 
normalized  throughput  is  thus  given  by 


IY  _  rl  (1-Pj(/)) 


=  {  max  {1  -  pi  -  2pt  -pa,  1  -  2Pl  -  2 p,}. 


(5.50) 


The  remaining  problem  is  to  find  the  probabilities  px,  p2,  and  ps  in  terms  of  the 
number  of  packet  transmissions. 


5.5.2.  Demodulator  Model  1:  Worst  Case 


In  computing  (5.48)  and  (5.49)  we  need  only  the  probabilities  Pi  +  p2,  pi  +  ps 
and  p2,  which  can  be  derived  as  follows: 

Pi  +  p2  =  P  (erasure,  error  |  I  users) 

+P(no  erasure,  error  |  I  users) 

=  P  (error  |  I  transmissions) 

=  P  (error  |  hit,  I)  P(hit  |  I) 


(5.51) 


=  1-1  /M 

+  P  (error  |  no  hit,  I)  P(no  hit  |  I) 


=o 

(1  -  l/M)pkiI, 


& 
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Pi  +  Pi  =  P  (erasure,  error  j  7) 

+P  (erasure,  no  error  |  7) 

=  P  (erasure  |  7) 

(5.52) 

=  P(erasure  j  hit,  /)P(hit  |  7) 

+P(erasure  |  no  hit,  7)P(no  hit  j  7) 

=  (1  -  Pm)pk%i  +  TV  (1  -  Pm)> 


Pi  =  P(no  erasure,  error  |  7) 

=  P  (error  |  no  erasure,  7)P(no  erasure  |  7) 

=  P(error  |  no  erasure,  hit,  7)P(no  erasure  |  hit,  7)P(hit  |  7) 

+  P (error  |  no  erasure,  no  hit,  7)  P(no  erasure  |  no  hit,  7)P(no  hit  |  7) 

s  s/  ✓ 

=0 

=  P  (error  |  no  erasure,  hit,  I) Pm  Ph,j- 

(5.53) 

Since  both  the  complete  demodulator  and  the  incomplete  demodulator  produce 
identical  symbols  if  the  symbol  produced  by  the  latter  is  not  an  erasure,  the 
probability  of  symbol  error  at  the  complete  demodulator  output  given  no  erasure 
at  the  incomplete  demodulator  output  is  the  same  as  that  at  the  incomplete 
demodulator  output  given  no  erasure.  That  is, 

7>(error[comp|  |  no  erasure[incompj,  hit,  7)  =  P  (error  [incomp)  |  no  erasure[incomp],  hit,  7) 

=  1  -  1/M. 

Thus  pt  is  given  by 

Pi  =  (1  -  l/Af)PMpM.  (5.54) 


Therefore, 


1  -  2p,  -  2pi  =  1  -  2 ph,i, 


(5.55) 


and 


1  -  pi  -  2pi  -  Pi  =  1  -  Pp  -  (1  +  Pm  ~  Pf)Ph,i •  (5.56) 
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The  resulting  asymptotic  achievable  regions  for  arbitrarily  small  error  probability 
is  given  by 


r  <  max  {1  -  2 p„,,  1  -  Pr  -  (1  +  Pu  -  Pr)Ph,i}, 


(5.57) 


and  the  asymptotic  normalized  throughput  is  given  by 
W  =  rIP{W 

4 

=  J  max  {1  -  2phj,  1  -  PF  -  (1  +  PM  ~  PF)Ph,i}  (5-58) 

=  {  max  {2(1  -  pky~l  -  1,  (1  +  PM-  Pf )(l  -  Ph )/_1  -  Pm}- 

Since 

1  —  2 ph,i  >  1  —  Pf  ~  (1  +  Pm  ~  PF)Ph,i , 
for 


(5.59) 


1  ^ 


=  /.a, 


(5.60) 


the  achievable  regions  are 

2(1  -  Pky-1  - 1, 


r  < 


I<ItH 

(1  +  Pm  —  PF){  1  —  Ph)1-1  —  Pm,  I  >  Itk, 
2e-"A  -  1,  A  <  Atfc 

(1  +  Pm  —  PF)e~r,x  —  Pm,  A  >  At*, 


(5.61) 


where 


(5.62) 


V  V  l  -  Pm 

as  I,q  —*  oo  while  A  =  I/q  is  held  constant.  Similarly  the  asymptotic  normalized 
throughput  is  given  by 

W  =  q  T  Pc{I) 

J(2(l-p,)/"1-l),  I<ItH 

q  [(1  +  Pm  —  PF)(  1  -  Ph y~l  —  Pm],  I  >  Ith, 


=  < 


(5.63) 


A(2e-"A  -  1), 


A  <  A 


^  *th 


A[(l  +  Pm  —  PF)e~nX  —  Pm],  A  >  A,*. 
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We  can  see  that  for  lower  traffic  (A  <  At*)  it  is  advantageous  to  select  the  “errors- 
only”  decoder,  and  for  higher  traffic  (A  >  Xtk)  it  is  advantageous  to  select  the 
“errors-and-erasures”  decoder.  This  implies  that  the  parallel  decoder  adapts  to 
the  level  of  channel  traffic  by  switching  between  two  decoding  modes.  Figures 
5.17  and  5.18  show  the  achievable  regions  and  the  normalized  throughputs  for 
various  values  of  Pm  and  Pf  respectively.  The  shaded  area  in  the  lower  traf¬ 
fic  region  indicates  the  performance  improvement  over  the  errors-and-erasures 
decoding  scheme.  Notice  that  the  performance  improvement  becomes  more  sig¬ 
nificant  as  the  side  information  is  less  reliable,  i.e.,  higher  Pm  and  Pf- 

On  the  other  hand,  the  requirement  on  ( Pm,Pf )  pair  for  the  errors-only 
decoder  to  perform  better  than  the  errors-and-erasures  decoder  can  be  obtained 
from  (5.58)  as 

pKi  +  (—^L£)  pr  ^  !.  (5-64) 

and  as  I,  q  — ♦  oo  while  A  =  I/q  is  held  constant  it  becomes 

p»  +  (rr^i) p"  5  »•  (5-65) 

Figure  5.19  indicates  regions  of  ( Pm,Pf )  pair  where  one  decoding  scheme  per¬ 
forms  better  than  the  other  for  given  A.  Notice  that  as  the  channel  traffic  in¬ 
creases,  the  errors-and-erasures  decoder  performs  better  even  for  less  reliable 
side  information,  and  as  the  channel  traffic  decreases,  the  errors-only  decoder 
performs  better  even  for  more  reliable  side  information. 


In  Figure  5.20  we  show  the  typical  form  of  the  normalized  throughput,  where 
A0l  and  Ao2  denote  the  optimum  channel  traffic  at  which  \{2e~r,x  -  1)  and 
A[(l  +  Pm  —  Pf)*~''x  —  Pm\  are  maximized  respectively,  and  We i  and  Wo2  are 
the  maximum  values  at  A„i  and  A0j  respectively.  It  has  been  shown  in  (3.47)  and 


.'Jf J !  >VV*  J  t-  W  UV  VV\  .V^l 
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orrors-nnd-erasures  decoding 


Figure  5.17:  Achievable  regions  of  code  rate  and  channel  traffic,  par 
allel  decoding,  demodulator  model  1. 


parallel  decoding 


—  —  —  errors-and-erasures  decoding 


Figure  5.18:  Normalized  throughputs  vs.  channel  traffic,  parallel  de¬ 
coding,  demodulator  model  1. 
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errors-and-erasures 
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Figure  5.19:  Regions  of  preferences,  demodulator  model  1. 


0  X«  X*,  X* 


Figure  5.20:  Typical  form  of  the  normalized  throughput  of  parallel 
decoding  system. 
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(3.48)  that 


A0l  =  0.3148/»7,  and  W0l  =  0.1448/r;. 


(5.66) 


To  get  Wo2 ,  we  take  the  derivative  of  A[(l  +  PM  —  PF)e  nX  —  Pm\  and  set  it  to 


&{A[(1  +  Pm-Pf)*-"a-Pm]}  =  (: l  +  PM-PF)e-^(l-VX)~PM 

=  0 


e-"A(l  —  r?A)  = 


1  +  Pm  —  Pf 


(5.67) 


The  above  nonlinear  equation  will  have  a  unique  solution,  which  is  Ao2,  by  the 
arguments  given  in  subsection  5.4.1.  Therefore  Wo2  is  obtained  from  (5.62)  and 
(5.66)  as 

Wo2  =  Ao2[(1  +  P„-Pr)e-’*«-PM]  ,  _ 


1— fyA0a 

From  (5.65)  and  (5.67)  it  can  be  shown  that  Wo2  >  Wo2  if 


(5.68) 


.  .  -0.1448+ v/(0.1448)a+0.5792PM 

Aoj  >  - - 


=  Ar. 


(5.69) 


Therefore  we  get  the  following  results: 


if  AoJ  <  Ar, 


if  Ao2  >  Ar, 


^  =  0.1448/77 
ropt  =  0.4611 

A  opt  =  0.314/77, 
ly  —  uEm. 

’'mat  —  i-nxo3 

r  .  —  nPx/ 
r°P*  ~  1-rjA.j 

A  opt  =  ^ol- 


(5.70) 
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5.5.3.  Demodulator  Model  2:  Realistic  Case 


The  probabilities  Pi  +  p2,  Pi  +  Pa,  and  p2  can  be  derived  as  follows: 


Pi  +  p2  =  P  (error  |  7  users) 

-  I  _ 

1  IPK  ’ 


(5.71) 


Pi  +  P3  =  P (erasure  J  7  users) 

=  X)m~=o  P(erasure  |  m  hits,  /)P(m  hits  )  7) 


PF{1  ~  PHj)  +  -  PM)  Emil 

Pf{  1  ~  Ph,l)  +  (1  -  Pm)pm> 


f  I- 1  ^ 


m 


?r(i  -  pO 


/— 1  — r 


(5.72) 


P2  = 


P  (error,  no  erasure  |  7  users) 

P  (error,  no  erasure  |  m  hits,  /)P(m  hits  |  7) 
S^LoP^rror  |  no  erasure,  m  hits,  7) 


P(no  erasure  |  m  hits,  7)P(m  hits  |  7) 


o  •  (i  -  pf){  i  -  ph)1-1  +  ^-xpM 


'  I- 


m 


?r(i  -  Ph) 


I—l—m 


J 


(5.73) 


'hus, 


i-2Pi-2P,=2-2<i-^,-i. 

iph 


(5.74) 


nd 


1  -  Pi  —  2p2  —  ps  —  (1  —  Pm  —  Pf)(  1  -  P/»)/_1  +  Pm  ^ 


2  —  2(1  —  p;,)7 


Jp* 


-  1  .  (5.75) 
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Therefore,  the  resulting  asymptotic  achievable  regions  for  arbitrarily  small  error 
probability  is  given  by 

r  <  (1-P«  -  P,)(l -*)'-■  + (!=*^-l)} 

(5.76) 

and  the  asymptotic  normalized  throughput  is  given  by 
W  =  max  {  (1  -  Pm  -  P, ) }(1  -  Ph)'-'  +  Pm  -  {)  } 

-  max{2=7f=i_A,  (1  -  Pm  -  ft)A«">»  +  Pm  («=*pi  -  A) } , 


as  I,  q  — *  oo  while  A  =  I/q  is  held  constant.  It  can  be  easily  shown  that 
—2‘—  -  A  S  (1  -  Pm  -  +  Pm  f—  ?  —  -  a)  , 


-  A  >  (1  -  Pu  -  P„)Ae-’A  +  Pm 


(5.77) 


(5.78) 


2enX  —  2  _A 


-  «•»*  > 


1  ~  -Puf  ~ 
1  _ 


(5.79) 


a  -  2  _  * 


/«  = 


Then  it  can  be  shown  for  both  rj= 1  and  2  that 


/'(A)  =  *£[«->» -(i,*AV2  +  <)A-l)| 


<  0, 


(5.80) 


(5.81) 


for  all  A  >  0.  This  implies  that  /(A)  is  a  decreasing  function  of  A,  whose  max¬ 
imum  is  1.  But,  since  the  RHS  of  (5.78)  is  a  constant  between  (-oo,l],  there 
exists  a  unique  threshold  in  channel  traffic,  denoted  A|a,  such  that  the  achievable 
region  and  the  asymptotic  normalized  throughput  are  given  by 


2-2e~’»A 


A  <  A'<fc 


(1  -  P„  -  P,)e-»  +  Pm  («=$*•  -  l)  ,  A  >  A’„ 


(5.82) 


2-2e~’,x  \  \  ^  \> 

w=  A’  -  “ 

(1  -  Pm  -  P,)Ae-'»  +  Pm  -  A)  ,  A  >  A',,. 


(5.83) 


V 
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The  achievable  regions  and  the  asymptotic  normalized  throughputs  are  plotted 


in  Figures  5.21  and  5.22  for  various  values  of  Pm  and  Pp  respectively.  The  shaded 


area  in  the  lower  traffic  region  indicates  the  performance  improvement  over  the 


errors-and-erasures  decoding  scheme.  As  in  subsection  5.5.2,  the  performance 


improvement  becomes  more  significant  as  the  side  information  becomes  less  re¬ 


liable,  i.e.,  higher  Pm  and  Pp.  By  comparing  Figures  5.17,  5.18,  5.21,  and  5.22, 


one  can  also  observe  that  the  performance  improvement  in  the  lower  traffic  re¬ 


gion  is  even  higher  with  the  demodulator  model  2  (realistic  model)  than  with 


the  demodulator  model  1  (worst  case). 

The  requirement  on  (Pm,  Pp)  pair  for  the  errors-only  decoder  to  perform 
better  than  the  errors-and-erasures  decoder  can  be  obtained  from  (5.77)  as 


9  _  i  o  _  i 

11  +  -  7,{Lir')]p“  +  p'  * 1  +  «* '  -  -(—*-)■ 


(5.84) 


Figure  5.23  indicates  regions  of  ( P\f,Pp )  pair  where  one  decoding  scheme  per¬ 


forms  better  than  the  other  for  given  A.  We  can  see  similar  phenomenon  as  in 


demodulator  model  1. 


Optimum  code  rate,  optimum  traffic,  and  maximum  normalized  throughput 


Let  Wa i  and  W0 2  be  the  maximum  values  of  (2  —  2e~r,x)/r)  —  A  and  (1  —  Pm  — 
PF) Xe~T,x  +  PM[{ 2  -  2e~'lX)/r)  -  A]  respectively,  and  A0l  and  A0,  be  the  channel 
traffics  at  which  Wol  and  Wo2  are  achieved  respectively.  It  has  been  shown  in 
(3.53)  and  (3.55)  that 


A„i  =  0.6931/tj  and  Wol  =  0.3069/t7. 


(5.85) 


In  section  5.4.2  it  has  been  shown  that  A02  is  the  (unique)  solution  of  (5.31). 


Thus, 


Wo2  =  -[(1  -PM-  Pjr)e-»A-  +  PM{  1  -  2Ao2)]. 
V 


(5.86) 
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Figure  5.22:  Normalized  throughputs  vs.  channel  traffic,  parallel  de¬ 
coding,  demodulator  model  2. 
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Figure  5.23:  Region  of  preferences,  demodulator  model  2. 


Therefore, 


max{WoUWo2}, 
f  0.6932/t?,  W0 1  >  Wo2 


Wol  <  Wo2, 


0.4427, 


Wol  >  wo2 


(1  ~Pm~  +  Pm  (*=*g ? 1 


-l),  Wol<Wo2. 


CHAPTER  VI 


CONCLUSIONS 


In  this  thesis  we  have  examined  the  multiple-access  capability  of  frequency- 
hop  packet  radio  networks  from  a  coding  point  of  view.  The  achievable  region 
of  code  rate  and  channel  traffic  and  the  normalized  throughput  were  considered 
as  performance  measures.  We  modeled  the  communication  system  from  the 
modulator  input  to  the  demodulator  output  as  an  /-user  interference  channel, 
and  evaluated  the  performance  of  several  codes  for  the  interference  channels  with 
perfect  side  information,  no  side  information,  and  imperfect  side  information. 

For  channels  with  perfect  side  information,  we  have  considered  the  perfor¬ 
mance  of  Reed-Solomon  codes  with  erasures-correction.  The  achievable  region  of 
code  rate  and  channel  traffic,  and  the  optimal  code  rate,  optimal  channel  traffic 
at  which  the  normalized  throughput  is  maximized  have  been  derived.  It  is  found 
that  the  maximum  sum  capacity  is  achieved  by  the  optimal  rate  Reed-Solomon 
code  with  bounded  distance  decoding.  Also,  it  is  shown  that  the  maximum 
normalized  throughput  obtained  with  frequency-hopped  spread-spectrum  mod¬ 
ulation  and  Reed-Solomon  coding  is  the  same  as  that  with  narrowband  ALOHA 
system  without  frequency-hopping.  This  implies  that  frequency-hopped  spread- 
spectrum  modulation  can  be  just  as  bandwidth-efficient  as  narrowband  modula¬ 
tion  in  the  sense  that  for  a  given  bandwidth  it  can  achieve  the  same  throughput. 
However,  for  the  narrowband  ALOHA  system  without  frequency-hopping  the 
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throughput  of  e~x  is  achieved  when  the  packet  error  probability  is  0.632  (which 
is  too  large  in  practical  sense)  and  with  binary  feedback,  while  for  the  frequency- 
hopped  spread-spectrum  modulation  it  is  achieved  with  arbitrarily  small  packet 
error  probability  and  without  feedback. 

Next  we  considered  the  performance  of  Reed-Solomon  codes  for  channels 
with  no  side  information.  It  is  found  that  the  maximum  normalized  throughput 
achievable  without  side  information  is  only  39.3  %  (worst  case)  of  that  achiev¬ 
able  with  perfect  side  information.  This  gives  us  a  quantitative  measure  of  the 
importance  of  side  information  in  improving  the  multiple-access  capability  of 
frequency-hop  packet  radio  networks. 

We  investigated  a  technique  for  obtaining  the  side  information.  This  is  done 
by  partitioning  the  data  stream  into  blocks  and  encoding  each  block  by  an  error- 
detecting  code ,  and  transmitting  the  encoded  block  (codeword)  during  a  single 
hop.  On  the  basis  of  the  received  version  of  the  codeword  the  decoder  makes  a 
statistical  decision  about  which  of  the  channel  states  [hit  or  no  hit)  each  codeword 
was  transmitted  over.  Clearly,  as  the  code  rate  decreases,  the  error  detection  ca¬ 
pability  increases,  therefore  the  reliability  of  the  side  information  obtained  will 
increase.  However,  decreasing  the  code  rate  implies  a  decrease  in  the  efficient 
use  of  the  channel.  With  this  notion  in  mind,  the  relationship  between  the  relia¬ 
bility  of  side  information  and  code  rate  has  been  investigated,  and  the  maximum 
allowable  code  rate  to  obtain  a  certain  reliability  of  side  information  has  been 
derived  for  both  synchronous  and  asynchronous  frequency-hopping  systems. 

The  above  combination  of  (inner)  encoder,  channel,  and  (inner)  decoder  gen¬ 
erates  in  general  an  errors-and-erasures  channel.  To  correct  the  errors  (caused 
by  undetected  errors)  and  the  erasures  (caused  by  detected  errors)  we  employed 
an  outer  code  (Reed-Solomon  code) .  In  this  way  the  inner  decoder  informs  the 


hit  by  symbols  from  other  packets.  It  is  shown  that  asymptotically  perfect  side 
information  can  be  generated  from  the  inner  code  without  any  loss  in  code  rate 
for  both  synchronous  and  asynchronous  frequency-hopping  systems,  so  that  the 
normalized  throughput  achievable  with  perfect  side  information  can  be  achieved 
through  the  use  of  this  concatenated  coding  scheme ,  even  though  the  channel 
provides  no  side  information. 

Finally,  we  considered  a  parallel  decoding  scheme  for  channels  with  imperfect 
side  information.  In  fact,  perfect  side  information  and  no  side  information  are 
special  cases  of  imperfect  side  information.  When  imperfect  side  information 
is  available  at  the  demodulator  its  output  is,  in  general,  a  sequence  of  errors, 
erasures,  and  correct  symbols.  In  order  to  correct  the  errors  and  erasures  we 
employed  a  Reed-Solomon  code,  and  considered  two  different  decoding  schemes 
for  it:  one  is  the  errors-and-erasures  decoding  and  the  other  is  a  parallel  decoding. 

We  first  evaluated  the  performance  of  errors-and-erasures  decoder,  and  found 
that  there  is  a  threshold  in  channel  traffic  such  that  for  the  lower  traffic  region  the 
performance  can  be  increased  by  making  a  hard  decision  demodulation  and  em¬ 
ploying  errors-only  decoding,  rather  than  trying  to  make  an  (erroneous)  erasure 
based  on  the  imperfect  (unreliable)  side  information  and  employing  errors-and- 
erasures  decoding. 

Based  on  this  observation  we  suggested  a  parallel  decoding  scheme,  and 
analyzed  the  performance  of  it  for  channels  with  imperfect  side  information. 
We  found  that  the  parallel  decoder  gives  better  performances  than  errors-and- 
erasures  decoder,  and  the  performance  improvement  becomes  more  significant  as 
the  side  information  becomes  less  reliable. 
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APPENDIX  A 


Proof  of  (3.4) 


>  5 

■ 

K 

;  <> 

L  Ta 

1 , 

Proof  of 

y 

y 

n—k 

t  r 

",  V 

*  r 

lim  ]T 

Aji\  -  Pk,i)n  ’  = 


1,  1  -  r  >  pkJ 

0.5,  1  -  r  =  phJ 
0,  1  -  r  <  pM, 


(A.l) 


where  r  =  k/n. 


Pk,i  =  P  (erasure) 

Xn  =  number  of  erasures  in  a  codeword 
Y.  =  XJn. 

Then  /  ^  s 

”  P’v(l-Pv)""’  =  P(0<Xn<n-k) 

i 

=  P(0  <  r„  <  1  -  r). 

From  the  weak  law  of  large  numbers  [Dav  70], 


(A.2) 


(A.3) 


nlim  P(|yn-pM|  >  e)  =0, 


(A.4) 


for  any  (  >  0.  This  implies 


lim  P( 0  <  yn  <  1  —  r)  = 

n,Jt— *oo 


1,  1  -  r  >  phj  +  e  o  1  -  r  >  pKI 
0,  1  -  r  <  phJ  -  €  «•  1  -  r  <  phJ. 


(A.5) 
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APPENDIX  B 


Derivation  of  Pm. 


Let  Nmj  denote  the  number  of  distinct  tone  positions  in  the  frequency  slot, 
each  containing  exactly  j  signals  given  m  hits  (i.e.,  m  +  1  signals  in  the  same  fre¬ 
quency  slot).  Then  the  tone  position  occupancy  distribution  within  a  frequency 
slot  can  be  represented  by  Nm,2»  •  •  • ,  ATm  m+1].  For  example,  consider  the 

case  of  m=3:  [2, 1,0,0]  corresponds  to  a  situation  in  which  one  tone  position  is  oc¬ 
cupied  by  two  users  and  two  tone  positions  are  singly  occupied.  Consider  another 
example,  m= 5  case:  [3, 0,1, 0,0,0]  corresponds  to  a  situation  in  which  one  tone 
position  is  occupied  by  three  users  and  three  tone  positions  are  singly  occupied. 
Using  this  notation  we  can  derive  Pm  as  follows. 

Pi  =  0  P(two  users  transmit  the  same  symbol) 

+  |P(two  users  transmit  different  symbols) 

=  0P([0,1])  +  1J>([2,0]) 

“  ■*"  * (1  —  5?) 

=  i(V)- 
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0  P  (three  users  transmit  the  same  symbol) 

+  |P(two  users  transmit  same  symbol,  the  third  user 
transmit  a  different  symbol) 

+  |P(all  three  users  transmit  different  symbols) 

0  P([0, 0, 1])  4  §P([1,1,0])  +  §P([3,0,0]) 

n  1  ,  ,  2  IM-D(M-l) 

uAfJ  2  M3  *r  3  M3 


6AT2 


0P([0, 0,0,1])  +  ip([l,  0,1,0])  +  2 P([0,  2,0,0])  4-  |P([2, 1,0,0]) 
+  fP([4, 0,0,0]) 

n  1  ■  l4(Af-X)  .  l3(M-l)  |  2  6(M~1)(M-2)  ,  3  (M-1HM-2HM-3) 
UM3  "r  2  M3  T!  M1  ~  3  M3  _r  4  M3 


3  M3-2M*-M 
AM3 


0P([0, 0,0,0, 1])  +  jP((l,0,0, 1,0])  +  |P([0,1, 1,0,0])  +  |P(]2,0, 1,0,0]) 
+  §P([1,2,0,0,0])  +  |P([3, 1,0, 0,0])  +  |P(]5,0, 0, 0, 0]) 

n  1  ,  X  5(M— X)  ,  1  10(M-11  .  2  10(Af-l)(Af-2) 

rj  M*  Ti  "r  3  M* 


T  5 


74M*-lSM3-lOM2+l 
30  M* 


=  0P([0,0,0,0,0,  l])  4*  jP([l,  0,0,0, 1,0])  4-  jP((0, 1,0, 1,0,0]) 

+  §P([2, 0,0, 1,0,0])  4-  ip((0, 0,2, 0,0,0])  +  §P([l,  1, 1,0, 0,0]) 
+  |P([3, 0,1, 0,0,0])  4-  |P([0, 3,0, 0,0, 0])  +  |P([2,2,0,0,0,0]) 
+  |P([4, 1,0, 0,0,0])  4-  |P((6, 0,0, 0,0,0]) 

_  «  1  ,  18(M-X)  ,  l  16(Af-l)  ,  2  15(W-l)fM-2) 

-  V  +  iV  +  j  ir  +  j  jp 

■  1  X0fAf-l)  ,  2  60(Ar-l)fM-2)  ,  3  20(M-l)(M-2)(M-3)  ,  2 
2  M3  tS  M3  ■r4  M3  '  3  M3 


2  M* 


3  45(Af-lHM-2)(Ar-3)  4  lS(M-l)(M-2)(M-3)lM-i)  ,  8  (M-lHM-2)(Af-3)(Af-4)(M-5) 

'  4  M3  5  M3  6  M4 


10M5  -6  AY4  -  5  AY 3  +M 
12A73 


*n  wi  nr  nr  *."■ 
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Notice  that  in  general  as  M  becomes  large,  Pm  is  dominated  by  the  last  term, 
ie.,  ^+iP(  [m  +  1,0,  •  •  •  ,0] ),  because 


P(  [m  +  1,0, •••,0]  )  = 


-  1, 


(B.l) 


for  large  enough  M.  Therefore,  Pm  =  ^7-r  for  large  enough  M. 


tJt 


ihj 
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APPENDIX  C 


Proof  of  (4.2) 


Proof  of 


lim  PJI) 

n,/t— »oo  V  ’ 


1,  1  —  r  >  +  Pd 

=  0.5,  1  -  r  =  2Pud  +  Pd 

0,  1  -  r  <  2P„j  +  Pd , 


where  r  =  fc/n. 


Let  random  variables  Xit  Y„,  and  Zn  be  defined  as 


0,  if  the  received  symbol  is  correct 
Xi  =  1,  if  the  received  symbol  is  erased, 

2,  if  the  received  symbol  is  in  error ,  t  =  1, 2,  •  •  • ,  n, 


r„  =  £x„ 


z  a  r.  -E(r.) 

\ZVar(y„) 


(C.l) 


(C.2) 


(0.3) 


where  E(Kn)  and  Var(yi,)  are  the  mean  and  the  variance  of  Yn  respectively. 

Then  Yn  is  the  total  number  of  erasures  and  twice  the  number  of  errors  in 
the  received  packet  (codeword).  Therefore  the  probability  of  correctly  decoding 
a  packet  PC(I)  is  given  by 


Pe(/)  =  P(y„<n-fc). 


(0.4) 
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l  .t  j  ■’«  i*l  IV Lt't.a' iUiIL^iL4 i 


Since  the  AT,,  t  =  1,2,  •••,«,  are  mutually  independent  (due  to  the  random 
frequency-hopping),  by  the  central  limit  theorem  [Dav  70] 


lim  P(Zn  <  z)  =  f  — L=e~u,/l2  du 

»-«  v  1  J-oo 


It  can  be  shown  that 


E(rn)  =  n{Pd  +  2Pud) 

Var(yn)  =  n{Pd-Pj  +  APwl-APld-\PdPj), 

P(X4  =  1)  =  Pd, 

P(Xt  =  2)  =  P^ 


for  t  =  1, 2,  •  •  • ,  n.  Therefore, 


Pe(I)  =  P(y„<n-*) 

- 


=  P  I  ^  < 


■y/n(l  —  T  —  Pd  —  2Purf) 

^  -  P!  +  4 P»d  -  4 Ph  -  APdPud 


1,  1  -  r~Pd-  2  Put  >  0 

•  0.5,  1  -r-Pd-  2P^  =  0 
0,  1  -  r  -  Pd  -  2 P,*  <  0.  Q.P.D. 


(C.5) 


(C.6) 


(C.7) 
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